× Looking for a useful answer?

Read this first and make sure you checked all steps: csvimproved.com/support/getting-started

Don't just say it doesn't work but describe in detail what is happening and add the following information:
* Version of the extension you are using
* CSVI version (Latest is not a version number)
* Sample of the file being imported
* A copy of the template you are using. Use the maintenance menu to create a backup of your template
* Collected debug information

Without this information you won't get a useful answer. If no debug log is attached, you will get a request to post it.

Where to get the debug information?

A tutorial ( csvimproved.com/support/questions-and-answers/390-how-to-collect-debug-information ) has been written to help you collect your debug information.

8 hours to import a 4mb file with 17 fields and 12500 lines

  • cpointcc
  • Topic Author
  • Offline
  • Fresh Boarder
  • Fresh Boarder
More
1 month 3 weeks ago #60342 by cpointcc
cpointcc created the topic: 8 hours to import a 4mb file with 17 fields and 12500 lines
I am hoping you can help me with this issue today. It is a ridiculous amount of time to import such a small file.

Can you provide me with any help in making this process go faster? I have 1 import file.

Is there a way to import directly via MySQL to this? J2Store support is putting this back on you as I am using your tool.

Please advise.

I can send you credentials to the site privately if you provide me a link or email

Please Log in or Create an account to join the conversation.

More
1 month 3 weeks ago #60344 by tharuna
tharuna replied the topic: 8 hours to import a 4mb file with 17 fields and 12500 lines
Hello,
8 hours for processing 12500 lines is way too much of time. Did you run the import manually or using cron? Setting the import to run using cron should be faster. Did you try that?

Is there a way to import directly via MySQL to this?

You cannot take values from one file to multiple tables using direct MySQL import. CSVI import processes the data and takes them to relevant tables in MySQL. You just need to find why your import is taking too much of time and a way to run it faster.

Kind regards,

Tharuna

=========================
If you use CSVI, please post a rating and a review at the Joomla! Extension Directory

Please Log in or Create an account to join the conversation.

More
1 month 3 weeks ago #60346 by tharuna
tharuna replied the topic: 8 hours to import a 4mb file with 17 fields and 12500 lines
Hello,
Also, are you trying to import external images? Can you post the debug log and sample of import file to check? Importing external images could be one cause for long import hours. Debug log will tell us what is taking so long. Please post it to check. To get the debug log check How to collect debug information? document.

Kind regards,

Tharuna

=========================
If you use CSVI, please post a rating and a review at the Joomla! Extension Directory

Please Log in or Create an account to join the conversation.

  • cpointcc
  • Topic Author
  • Offline
  • Fresh Boarder
  • Fresh Boarder
More
1 month 3 weeks ago #60349 by cpointcc
cpointcc replied the topic: 8 hours to import a 4mb file with 17 fields and 12500 lines
I will test the cron job and get back to you. Images were uploaded prior and only the field with the image path reference was imported.

Please Log in or Create an account to join the conversation.

  • cpointcc
  • Topic Author
  • Offline
  • Fresh Boarder
  • Fresh Boarder
More
1 month 3 weeks ago #60350 by cpointcc
cpointcc replied the topic: 8 hours to import a 4mb file with 17 fields and 12500 lines
It was a manual import. I will test a cron job today.

Please Log in or Create an account to join the conversation.

  • cpointcc
  • Topic Author
  • Offline
  • Fresh Boarder
  • Fresh Boarder
More
1 month 3 weeks ago - 1 month 3 weeks ago #60353 by cpointcc
cpointcc replied the topic: 8 hours to import a 4mb file with 17 fields and 12500 lines
I am not seeing much improvement here. The cron job forecast is not better. I've tried 2 imports 1st ran for 2 hours - I got 3000 lines imported, then I killed the job. Deleted data from the tables and restarted with a new test and got 800 in 1/2 hour. This is totally unacceptable. I could use some help here.

Attached is the last cron log file

File Attachment:

File Name: com_csvi.log.1.zip
File Size:9 KB

File Attachment:

File Name: com_csvi.log.2.zip
File Size:9 KB

File Attachment:

File Name: com_csvi.log.3.zip
File Size:9 KB
Attachments:
Last edit: 1 month 3 weeks ago by cpointcc. Reason: added log files

Please Log in or Create an account to join the conversation.