Main

03/01/2017

02:31 AM Revision e4ceb06d: Merge branch 'master' of baranovich.homelinux.org:/home/dsorber/trac/projects/headquarters/repo

David Sorber

02:30 AM Revision 3eeb1485: Moved things around so that the main thread breaks off pieces of work and hands them to the threads. This version has less than half the runtime of the previous version for the Photos library test set!

David Sorber

02/28/2017

09:37 PM Revision 3dfe7131: Adding simple program that computes the cosine similarity of two ClusterNode structures.

David Sorber

02/27/2017

01:58 AM Revision 2423ae90: I finally found the mystery error that I've been trying to figure out for a while now. The issue was the dreaded too many file descriptors open. This was caused by not closing the pipe() file descriptors from the parent. I also noticed that handing each instance of packjpg the maximum number of files it can take leads to problems. I guess this is also a cause of "too many file descriptors open", so I have limited the number of files handed to each instance of packjpg to 40. The entire program now runs to completion using my Photos library as a (quite large) test data set!

David Sorber

02/24/2017

06:49 PM Revision c2405714: Adding header file that I forgot to add last time around. I also finished up a multithreaded version of the make random nodes script that can create 1 million nodes in ~20 seconds.

David Sorber

02/23/2017

08:58 PM Revision 095cc187: Adding preliminary code for making random nodes.

David Sorber

02/22/2017

01:06 AM Revision 43c9a095: Fixing the bug I discovered yesterday... I meant to use rfind() instead of find(). I should be ready for another full test.

David Sorber

02/21/2017

10:56 PM Revision c8352650: WIP commit, stashing these debugging changes so I can go mobile.

David Sorber

10:19 PM Revision 57e6c22f: Finished up the changes to make argv a std::vector instead of a regular array. I also implemented the changes to control the size of argv based on system configuration and potentially spawn packJPG multiple times in order to handle a very large number of files. I ran a test on my Photos library and it sort of worked but I ran into some issues that I still need to diagnose.

David Sorber

02/20/2017

12:56 AM Revision e0b7f8b9: WIP commit. I started converting the argv list to a std::vector and adding logic to make sure it does not exceed the maximum argv size.

David Sorber