Skip to main content

​
Overview

Wirekite supports Oracle 11g and above as a target database for:
  • Schema Loading - Create target tables from Wirekite’s intermediate schema format
  • Data Loading - Bulk load extracted data into Oracle tables
  • Change Loading (CDC) - Apply ongoing changes using MERGE operations
Oracle loaders use OCI (Oracle Call Interface) for high-performance bulk loading. The Change Loader uses shadow/merge tables for atomic change application.

​
Prerequisites

Before configuring Oracle as a Wirekite target, ensure the following requirements are met:

​
Database Configuration

  1. Version: Oracle 11g or above
  2. User Permissions: Create a dedicated Wirekite user with:
    • CREATE TABLE privilege
    • INSERT, UPDATE, DELETE on target tables
    • Read/write access to Wirekite internal tables (wirekite_progress and wirekite_action)

​
File System Access

  • Ensure the user running Wirekite has write permissions to the work directory
  • Verify sufficient disk space for intermediate files during change loading
Use the Wirekite cmdline tool or Oracle SQL*Plus to interact with the database and verify connectivity before running loaders.

​
Schema Loader

The Schema Loader reads Wirekite’s intermediate schema format (.skt file) and generates Oracle-appropriate DDL statements for creating target tables.
The Schema Loader generates both base tables and merge tables (with $wkm suffix) for CDC operations.

​
Required Parameters

​
schemaFile
string
required
Path to the Wirekite schema file (.skt) generated by the Schema Extractor. Must be an absolute path.
​
createTableFile
string
required
Output file for CREATE TABLE statements. Includes both base tables and merge tables for CDC operations.
​
createConstraintFile
string
required
Output file for constraint definitions (indexes, unique constraints, check constraints).
​
createForeignKeyFile
string
required
Output file for FOREIGN KEY constraints. Can be applied after initial data load for better performance.
​
logFile
string
required
Absolute path to the log file for Schema Loader operations.

​
Optional Parameters

​
dropTableFile
string
default:"none"
Output file for DROP TABLE IF EXISTS statements. Set to “none” to skip generation.
​
createRecoveryTablesFile
string
default:"none"
Output file for recovery table creation SQL. Set to “none” to skip.
​
createMergeTables
boolean
default:"true"
When true, generates merge tables ($wkm suffix) for CDC operations. Set to false if only doing data loads without change capture.
​
mergeTablesOnly
boolean
default:"false"
When true, only creates merge tables, skipping base table creation. Useful for bounce-back scenarios.

​
Data Loader

The Data Loader reads Wirekite’s intermediate data format (.dkt files) and loads records into Oracle target tables using high-performance OCI bulk operations.

​
Required Parameters

​
dsnFile
string
required
Path to a file containing the Oracle connection string.
Connection string format: 
username/password@host:port/service_name
Example: 
wirekite/[email protected]:1521/ORCL
​
inputDirectory
string
required
Directory containing data files (.dkt) to load. Files are processed in parallel based on maxThreads.
​
schemaFile
string
required
Path to the Wirekite schema file used by Schema Loader. Required for table structure information.
​
logFile
string
required
Absolute path to the log file for Data Loader operations.

​
Optional Parameters

​
maxThreads
integer
default:"5"
Maximum number of parallel threads for loading tables. Each thread loads one table at a time.
​
hexEncoding
boolean
default:"false"
Set to true if data was extracted using hex encoding instead of base64.
​
useOCILoader
boolean
default:"true"
When true, uses the C OCI bulk loader for approximately 100x faster performance. When false, uses Go row-by-row insertion.
​
dataFileExtension
string
default:"dkt"
File extension for data files to process.
For best performance, set maxThreads equal to the number of CPU cores available and keep useOCILoader enabled.

​
Change Loader

The Change Loader applies ongoing data changes (INSERT, UPDATE, DELETE) to Oracle target tables using a merge approach with shadow tables.
The Change Loader requires merge tables to be created by the Schema Loader. It uses Oracle’s MERGE statement for atomic change application.

​
Required Parameters

​
dsnFile
string
required
Path to a file containing the Oracle connection string.
Connection string format: 
username/password@host:port/service_name
​
inputDirectory
string
required
Directory containing change files (.ckt) from the Change Extractor.
​
workDirectory
string
required
Working directory for temporary CSV files during merge operations. Must be writable.
​
schemaFile
string
required
Path to the Wirekite schema file for table structure information.
​
logFile
string
required
Absolute path to the log file for Change Loader operations.

​
Optional Parameters

​
loadLocal
boolean
default:"true"
When true, loads changes locally. When false, uses remote loading methods.
​
maxFilesPerBatch
integer
default:"30"
Maximum number of change files to process in a single batch before executing MERGE operations.
The Change Loader should not start until the Data Loader has successfully completed the initial full load.

​
Orchestrator Configuration

When using the Wirekite Orchestrator, prefix target parameters with target.schema., target.data., or target.change. depending on the operation. Example orchestrator configuration for Oracle target: 
# Main configuration
source=postgres
target=oracle

# Schema loading
target.schema.schemaFile=/opt/wirekite/output/schema/wirekite_schema.skt
target.schema.createTableFile=/opt/wirekite/output/schema/create_tables.sql
target.schema.createConstraintFile=/opt/wirekite/output/schema/constraints.sql
target.schema.createForeignKeyFile=/opt/wirekite/output/schema/foreign_keys.sql
target.schema.logFile=/var/log/wirekite/schema-loader.log

# Data loading
target.data.dsnFile=/opt/wirekite/config/oracle.dsn
target.data.inputDirectory=/opt/wirekite/output/data
target.data.schemaFile=/opt/wirekite/output/schema/wirekite_schema.skt
target.data.logFile=/var/log/wirekite/data-loader.log
target.data.maxThreads=8
target.data.useOCILoader=true

# Change loading (CDC)
target.change.dsnFile=/opt/wirekite/config/oracle.dsn
target.change.inputDirectory=/opt/wirekite/output/changes
target.change.workDirectory=/opt/wirekite/work
target.change.schemaFile=/opt/wirekite/output/schema/wirekite_schema.skt
target.change.logFile=/var/log/wirekite/change-loader.log
target.change.maxFilesPerBatch=30
For complete Orchestrator documentation, see the Execution Guide.