Load data infile - where to store? Use Envoy?
This is not actually related to Laravel, but my hope is that it might be since that would mean there is a Laravel-way to do it ;).
So. I get large datasets monthly (.tsv-files), which I import to my database (MySQL). Mysql command line tool has the "load data infile", which is, in my case, about 250x faster then doing some PHP-import. The files are quite big (5gb), so I don't want to put them in my version control. I also use Forge, so my dream is to be able to create some Artisan command that will do the heavy lifting. Why? Because some things, for instance DB credentials is not the same in every environment, and since i already have this configured in Laravel i would rather not have one more place to change.
So my first question is: have anyone (successfully) been able to to "load data infile" from within Laravel?
The second question is: how do you store these kind of files? My best option right now is to simply symlink app/resources/data (or whatever the folder is called), but is there a better way?
Thanks in advance!
Want to reply to this thread?Login with github.