Bulk Importing Data

📘

Learning Objectives

  • Understand the import process, with or without a profile.
  • Learn the key steps to configure and execute a one-time or recurring import.
  • Learn best practices and key solutions.


Bulk Data Importing

The PIM import feature allows users to quickly transfer data into the platform using structured files. Imports can be performed as one-time or recurring processes through import profiles.



Importing Data with a Profile

It is possible to initiate an import process without having created a profile beforehand. However, the system will then prompt you to define the import profile settings, which essentially creates one. Therefore, we recommend always starting by creating an import profile before launching an import.

  1. Select a Profile:

    • From the Launch an Import page, choose a profile to speed up the process.
  2. Configure the File and Source:

    • Accepted Formats:
      • XLSX (max. 10 MB),
      • CSV (no size limit, up to 200,000 rows).
    • File Source:
      • Local: Upload a file from your computer.
      • Remote: Provide a link (FTP, SFTP, HTTP/HTTPS) with credentials.
    Capture d’écran 2024-12-24 à 09.55.51.png
  3. Start the Import:

    • Click the Import Data button once the configuration is complete.
  4. Or Schedule a Recurring Import:

    • From the Scheduled Imports page,
    • Click the Schedule an Import button,
    • Fill in the details: profile, frequency (via Crontab), time zone, and file source,
    • Click the Create button to validate the recurring import process.


Best Practices

  • File Organization:
    • Use consistent file naming for scheduled imports.
    • Check file format and data before importing.
    • Remove all duplicates from your file.
  • Format Compliance:
    • Use standard encodings (UTF-8 for .csv).
    • Verify separators and date/time formats.
  • Pre-Import Checks:
    • Enable Mapping if necessary to prevent errors.
    • Analyze your file before launching the import using the Analyze My File option.


Error Handling

  • Non-compliant Files:
    • Check formats, columns, and required attributes.
    • Review logs to identify and resolve specific errors (e.g., 404 error for a remote source).
  • Column Errors:
    • Correct incorrect values directly in the source file.


📘

Summary

  • Import Feature:

    • Enables bulk data transfer via structured files (XLSX or CSV).
    • Supports one-time or recurring imports using import profiles.
  • Key Steps:

    • Select a profile or define one when importing for the first time.
    • Configure the file and source: local or remote file.
    • Launch the import or schedule a recurring import with detailed parameters (frequency, time zone, etc.).
  • Best Practices:

    • Organize and verify your files before importing.
    • Follow standard formats (UTF-8, separators, date/time formats).
    • Remove all duplicates.
    • Analyze files to anticipate potential errors.
  • Error Management:

    • Identify issues in logs (non-compliant files, source errors).
    • Fix missing values or attributes directly in the source file.



Next Chapter

Now that you know how to import bulk data, let’s learn how to Bulk Exporting Data.