I have some very large data files i need to add to a database. The file includes geographical data, and the file is about 72,000 lines. If i try to update it, of course, the script times out. Does any one have any strategies to update the database?

Do you have admin access to your server?

Gee, this kinda sounds familiar.

synikal,

RVirtue and I ran into the exact same problem with the Netquery module.

Have you tried uploading the file via phpMyAdmin? If that still times out, you may want to break the file into smaller chunks and import them one at a time.

You know this script Bigdump ?

There is a comprehensive FAQ HERE about this.

I don't have admin access... Before, I wrote a cmd line script and wrote the system admin and asked them to do it.

thanks for the info though

While the FAQ is good as far as it goes, I'm not sure that its backup/restore advice fully addresses this user's situation. And, unfortunately, when it comes to adding a large amount of new data to a database, the potential issues are manifold.

In addition to the default PHP timeout (30 seconds) mentioned briefly in the FAQ, I've also found (after much head banging) that some service providers impose their own "unadvertised" restrictions on SQL queries, even for so-called "business package" accounts. In fact, my experience also suggests that the XOOPS module installer itself is not without a few quirks of its own when it comes to handling new SQL dB additions that are larger than "normal".

Basically, there are two "workaround" approaches. The first involves using a l-o-n-g series of single record inserts. The phpMyAdmin utility can be made to export data that way if one unchecks its "extended" option. Alternatively, one can split the large insert into smaller "chunks". (In my own case, approximately 2000 records each seemed to satisfy the limits imposed by my service provider, but others may vary, of course.) The latter approach looks something like this:

Hope that helps.