I've been processing large csv files and keep seeing the same records processed multiple times without ever continuing past a certain place in the file. It seems as if just a part of the csv file gets reprocessed over and over again in a loop. I haven't been able to determine the cause of the problem, so I've deleted records from the feeds_source table and tried again by creating a new csv file starting with the first unprocessed record.

I have noticed that small problems with the csv file itself can cause feeds to break. For example a double quote within a field is treated as a text qualifier causing multiple records to all combine into a single field (until the next double quote is located). This tends to stop processing.

I'm hoping someone has seen this behavior and can point me in the right direction regarding the restarting issue. My hunch is that it's also caused by a problem with the csv file itself because it doesn't happen every time with every file.

Comments

davemaxg’s picture

davemaxg commented
Issue summary: View changes

a couple typos

bluegeek9’s picture

bluegeek9 commented
Issue summary: View changes
Status: Active » Closed (outdated)

Drupal 7 reached end of life and the D7 version of Feeds is no longer being developed. To keep the issue queue focused on supported versions, we’re closing older D7 issues.

If you still have questions about using Feeds on Drupal 7, feel free to ask. While we won’t fix D7 bugs anymore, we’re happy to offer guidance to help you move forward. You can do so by opening (or reopening) a D7 issue, or by reaching out in the #feeds channel on Drupal Slack.

If this issue is still relevant for Drupal 10+, please open a follow-up issue or merge request with proposed changes. Contributions are always welcome!

Now that this issue is closed, review the contribution record.

As a contributor, attribute any organization that helped you, or if you volunteered your own time.

Maintainers, credit people who helped resolve this issue.