pelican faqs

Yes, Pelican is a zero coding web UI tool that makes the interaction between the software and the user seamless.

Datametica’s Pelican is a state-of-the-art data validation technology that requires ZERO coding. Even a non-technical person can run the validations, understand the reports, and perform bug triage as per the tool’s recommendations.

Datametica’s Pelican performs various types of cell-level validation like Data, Metadata, and Scope.

• Data 
  • Cell level comparison between two tables. Two modes available: 
    • Litmus – Quick check 
    • Full – Comprehensive check 
      • Identification of all columns with mismatching cells in single execution
      • Samples of mismatches

• • • Mismatch data reconciliation between two tables. Parameters:
      • Mismatched rows
      • Missing / Extra rows
      • Duplicate rows 

• Metadata 
  • Column positional ordering
  • Data type

• Scope 
  • Full table
  • Incremental data

Pelican product development follows an extensive SDLC process. This includes testing all the integration points to ensure the highest standards of security compliance, for e.g., vulnerability scans, metadata and data security, network security, and user security.

Pelican is an enterprise application deployed in the customer network for data validation. It is used only by the employees and partners who have secured access to the network. PELICAN does not need access to any outside network. Pelican access is controlled by a ground delivery team, which is covered by an NDA agreement with customers.

The recommended baseline infrastructure configuration required to run Pelican effortlessly is a Docker or GKE machine equivalent to a machine type of n1-standard-32 or higher.

Pelican runs simple SQL queries on both Source and Target platforms. Usually the Pelican user is allocated a specific capacity and resources to avoid impacts to existing workloads.

Pelican has an inbuilt intelligent algorithm that identifies data type difference between two platforms and utilizes options like expression and user inputs to make sure they are handled correctly for validation.

Yes, Pelican offers the ability to interact programmatically with the help of APIs. APIs can be used to configure, manage and process table validations within Pelican from the customer’s enterprise scheduler.

Pelican offers high data security during data validation as it doesn’t move the actual data on either the source or target over the network for comparison. It uses hashing mechanisms that enable it to validate without actually moving data or creating copies of the existing data, i.e., zero data movement. This helps save valuable storage space, network bandwidth and reduces data leakage risk. Read our case study about a similar use case here.

As mentioned on our Pelican product page, the following are the source and target pairs that are supported by Pelican:

There are various Pelican deployment options based on the source and target data warehouses. Here is the list: