I've spent a good part of the last week improving importing to make sure that the nightmare import that happened last week won't repeat itself. The amount of data had to be processed has been doubled since last time, and still the live import took only 30 minutes. To be honest it took 10 minutes, the rest was the purging of the expired disk cache. So, what changed?
The official blog of Jabbithole, the WildStar database built by cupcakes for cupcakes at www.jabbithole.com
Showing posts with label import. Show all posts
Showing posts with label import. Show all posts
Monday, June 23, 2014
Friday, June 13, 2014
The import of Friday the 13th
The import process is still running, as it appears I royally underestimated the time needed for the database server to get through the last batch. About 4.5GB of raw data has been pre-processed into a 700MB SQL that is still being imported as I write this. Many small mistakes escalated into the current situation, here is what happened:
Subscribe to:
Posts (Atom)