Product Import - Query Too Complex

[dcrocker]

I am needing to load 20 to 30k of products into Actinic v7.
The site uses single page products with products grouped by category e.g.
category (section) > product header (sub-section) > product details (product)

I plan to place the new products into groups of 50 (templates will show these as a single list 50 at a time) e.g.
category1 > product1_header > product1_detail
category1 > product2_header > product2_detail
....
category1 > product50_header > product50_detail

I have used a hierarchical file to create the top level sections.

I then use a flat file to load in the subsections and related products. After about 18k of products I get the message:
"An error occured while linking to the external database. This may occur if one or more field names have been changed in the external database. Check the field mapping in File | External Links. Error reported:- Query is too complex."

At this point the subsections keep getting created but it won't create the underlying products. However those product references do appear to be in the database so it's obviously struggling to make the links.

I can see that this question has been asked before but I can't find a satisfactory outcome. The database is still only about 30MB in size so it's certainly not reached Access' limit.

Any suggestions? We are reluctant to move away from v7 because we have heavily bespoked templates.

Thanks in advance.

[Duncan Rounding]

Can you perhaps import in smaller chunks to see if it helps. I'm not sure how the parsing works with the import file - whether it processes in one pass or more, especially if you have lots of components etc.

[dcrocker]

Have tried this in 5k chunks and still the same problem arises at around the total of 18k. Have then tried it in chunks of just 50 - no joy either I'm afraid.

[leehack]

Sounds like too many products to me especially with SPP setup. 20k products they say, but with SPP this is somewhat reduced, 20k would be for MPP as i see it. I think you're bringing it to its knees.

[dcrocker]

Certainly does look like I'm trying to push it. Hmmm, looking like we'll have to think again about the whole approach.

[Duncan Rounding]

The section pages are probably what's causing it to max out but have you tried to import using an heirarchical file instead - the query max may be different with different parsing.

Either way you do need to combine as many similar items into one page as possible to reduce the number of pages.