Main

02/28/2017

09:37 PM Revision 3dfe7131: Adding simple program that computes the cosine similarity of two ClusterNode structures.

David Sorber

02/27/2017

01:58 AM Revision 2423ae90: I finally found the mystery error that I've been trying to figure out for a while now. The issue was the dreaded too many file descriptors open. This was caused by not closing the pipe() file descriptors from the parent. I also noticed that handing each instance of packjpg the maximum number of files it can take leads to problems. I guess this is also a cause of "too many file descriptors open", so I have limited the number of files handed to each instance of packjpg to 40. The entire program now runs to completion using my Photos library as a (quite large) test data set!

David Sorber

02/24/2017

06:49 PM Revision c2405714: Adding header file that I forgot to add last time around. I also finished up a multithreaded version of the make random nodes script that can create 1 million nodes in ~20 seconds.

David Sorber

02/23/2017

08:58 PM Revision 095cc187: Adding preliminary code for making random nodes.

David Sorber

02/22/2017

01:06 AM Revision 43c9a095: Fixing the bug I discovered yesterday... I meant to use rfind() instead of find(). I should be ready for another full test.

David Sorber

02/21/2017

10:56 PM Revision c8352650: WIP commit, stashing these debugging changes so I can go mobile.

David Sorber

10:19 PM Revision 57e6c22f: Finished up the changes to make argv a std::vector instead of a regular array. I also implemented the changes to control the size of argv based on system configuration and potentially spawn packJPG multiple times in order to handle a very large number of files. I ran a test on my Photos library and it sort of worked but I ran into some issues that I still need to diagnose.

David Sorber

02/20/2017

12:56 AM Revision e0b7f8b9: WIP commit. I started converting the argv list to a std::vector and adding logic to make sure it does not exceed the maximum argv size.

David Sorber