we had intended to migrate to Solr, but not this soon in the development process. This may force our hand. Eric On Wed, Jan 18, 2012 at 12:51 PM, Matt Graham wrote: > From: Eric Cope >> good point. Its just a series of INSERTs (8000 or so), but the table >> has a fulltext index, so its pretty slow (10 records/sec). >> It sounds like I should split up the batch script, then load a few, >> pause, load a few, pause, etc. > > Run through 10 inserts, sleep 1, 10 inserts, sleep 1, until finished.  I don't > think that you can do "sleep 1" in SQL, though, so this means putting the > queries through a shell/PHP/something wrapper.  This would mean the inserts > would take longer, but the webserver would probably be usable while the whole > thing was running. > >> Any ideas? > > Something that might work down the road is to turn off full-text indexing and > offload searches like that to an instance of sphinx.  Then you could have the > table you're inserting into be InnoDB, which has all kinds of useful benefits > (yay row-level locking).  The tradeoff is that you have to learn sphinx, use > it, and set up a cron to regenerate the sphinx indexes every hour or half-hour > or something.  This might not be worth it for your application. > > -- > Matt G / Dances With Crows > The Crow202 Blog:  http://crow202.org/wordpress/ > There is no Darkness in Eternity/But only Light too dim for us to see > > --------------------------------------------------- > PLUG-discuss mailing list - PLUG-discuss@lists.plug.phoenix.az.us > To subscribe, unsubscribe, or to change your mail settings: > http://lists.PLUG.phoenix.az.us/mailman/listinfo/plug-discuss --------------------------------------------------- PLUG-discuss mailing list - PLUG-discuss@lists.plug.phoenix.az.us To subscribe, unsubscribe, or to change your mail settings: http://lists.PLUG.phoenix.az.us/mailman/listinfo/plug-discuss