Adding the all important "-march=native" compile flag to the packJPG CMakeLists.txt.
Merge branch 'master' of baranovich.homelinux.org:/home/dsorber/trac/projects/headquarters/repo
Moved things around so that the main thread breaks off pieces of work and hands them to the threads. This version has less than half the runtime of the previous version for the Photos library test set!
Adding simple program that computes the cosine similarity of two ClusterNode structures.
I finally found the mystery error that I've been trying to figure out for a while now. The issue was the dreaded too many file descriptors open. This was caused by not closing the pipe() file descriptors from the parent. I also noticed that handing each instance of packjpg the maximum number of files it can take leads to problems. I guess this is also a cause of "too many file descriptors open", so I have limited the number of files handed to each instance of packjpg to 40. The entire program now runs to completion using my Photos library as a (quite large) test data set!
Adding header file that I forgot to add last time around. I also finished up a multithreaded version of the make random nodes script that can create 1 million nodes in ~20 seconds.
Adding preliminary code for making random nodes.
Fixing the bug I discovered yesterday... I meant to use rfind() instead of find(). I should be ready for another full test.
WIP commit, stashing these debugging changes so I can go mobile.
Finished up the changes to make argv a std::vector instead of a regular array. I also implemented the changes to control the size of argv based on system configuration and potentially spawn packJPG multiple times in order to handle a very large number of files. I ran a test on my Photos library and it sort of worked but I ran into some issues that I still need to diagnose.
View revisions
Also available in: Atom