I only have one column that is needed for the fulltext search. I think it would be easier to integrate solr than to try and get MySQL to be better. But this comes from someone who has never used solr. So far, I have used csplit to split the file, insert one record, sleep for 0.01s and repeat. Its slower, but at least it doesn't cripple the server and when we launch this app, we can invest in solr then. On that note, I'd be interested in any tutorials anyone might have with respect to getting solr up and running. my attempts thus far have failed, all on CentOS. Eric On Wed, Jan 18, 2012 at 3:48 PM, Lisa Kachold wrote: > Hi! > > > On Wed, Jan 18, 2012 at 1:27 PM, Alex Dean wrote: >> >> On Jan 18, 2012, at 1:30 PM, Eric Cope wrote: >> >> > good point. Its just a series of INSERTs (8000 or so), but the table >> > has a fulltext index, so its pretty slow (10 records/sec). >> > It sounds like I should split up the batch script, then load a few, >> > pause, load a few, pause, etc. >> > Any ideas? >> > >> > Eric >> >> Look at 'alter table disable/enable keys' >>  you tell the server not to update any indexes while you're doing your >> bulk load. >>  http://dev.mysql.com/doc/refman/5.1/en/alter-table.html >> >> Consider loading via tab-delimited rather than SQL. >>  Much much faster, but the data file must be on the mysql server's >> filesystem. >>  http://dev.mysql.com/doc/refman/5.1/en/load-data.html >> >> As others suggested, do inserts in batches and sleep. >> >> alex > > -- > > How about clustering ndbcluster; with a query only node? > > (602) 791-8002  Android > (623) 239-3392 Skype > (623) 688-3392 Google Voice > ** > HomeSmartInternational.com > > > --------------------------------------------------- > PLUG-discuss mailing list - PLUG-discuss@lists.plug.phoenix.az.us > To subscribe, unsubscribe, or to change your mail settings: > http://lists.PLUG.phoenix.az.us/mailman/listinfo/plug-discuss --------------------------------------------------- PLUG-discuss mailing list - PLUG-discuss@lists.plug.phoenix.az.us To subscribe, unsubscribe, or to change your mail settings: http://lists.PLUG.phoenix.az.us/mailman/listinfo/plug-discuss