8. Exporting Data

Overview

After preparing and analyzing your data, you can export it in various formats for use in other applications, sharing with stakeholders, or archival purposes.

Export Options

Quick Export

Fastest way to export:

💡 UI Location: Find the export button (download icon ⬇) in the toolbar when viewing any data source

1. Select data source in Data Sources panel
2. Click export icon (⬇)
3. Choose format
4. Click "Export"
5. Choose save location

This exports:
- All rows and columns
- Using default format settings
- To a single file

Prepare & Export

For more control, use Prepare Wizard:

1. Click "Prepare" in sidebar
2. Go through wizard steps (clean, transform)
3. Step 6: Export Configuration
4. Configure export settings
5. Export

Benefits:
- Clean data before export
- Select specific columns/rows
- Apply transformations
- Handle PII
- Multiple output options

Export Formats

CSV (Comma-Separated Values)

Best for:
- Excel/Google Sheets import
- Database bulk loading
- Data exchange between systems
- Long-term archival

Configuration options:

Delimiter:
- Comma (,) - Standard
- Tab (\t) - TSV format
- Semicolon (;) - European format
- Pipe (|) - Database-friendly
- Custom

Text Qualifier:
- Double quote (") - Standard
- Single quote (')
- None

Encoding:
- UTF-8 (recommended) - Universal
- UTF-8 with BOM - Excel-friendly
- ISO-8859-1 - Legacy systems
- Windows-1252 - Microsoft systems

Options:
- ☑ Include header row
- ☑ Quote all text fields
- ☑ Escape special characters
- Date format: YYYY-MM-DD
- Null value: (empty), NULL, N/A

File size: Efficient, human-readable

Excel (.xlsx)

Best for:
- Business users
- Formatted reports
- Multi-sheet workbooks
- Formulas and calculations

Configuration options:

Worksheet Options:
- Single sheet (all data)
- Multiple sheets (grouped by category)
- One sheet per source

Formatting:
- ☑ Auto-fit columns
- ☑ Freeze header row
- ☑ Apply data types
- ☑ Format numbers (currency, percentage)
- ☑ Conditional formatting (optional)

Advanced:
- Include formulas
- Add summary sheet
- Insert charts (optional)
- Password protect

File size: Larger than CSV, feature-rich

JSON (JavaScript Object Notation)

Best for:
- APIs and web services
- NoSQL databases
- Modern applications
- Nested/hierarchical data

Configuration options:

Format:
- JSON Array - [{...}, {...}]
json [ {"id": 1, "name": "Alice"}, {"id": 2, "name": "Bob"} ]

• JSON Lines - One object per line
  json {"id": 1, "name": "Alice"} {"id": 2, "name": "Bob"}

• Nested - Hierarchical structure
  json { "data": [ {"id": 1, "name": "Alice"}, {"id": 2, "name": "Bob"} ] }

Options:
- Pretty print (indented)
- Compact (minified)
- Date format: ISO 8601
- Null handling: null vs exclude

File size: Larger than CSV, self-describing

Parquet

Best for:
- Big data systems (Spark, Hadoop)
- Data warehouses
- High-performance analytics
- Large datasets

Configuration options:

Compression:
- None - Fastest, largest
- Snappy - Balanced (recommended)
- Gzip - Smaller, slower
- Brotli - Maximum compression

Schema:
- ☑ Include metadata
- ☑ Column statistics
- ☑ Schema evolution support

Performance:
- Row group size: 128MB (default)
- Page size: 1MB (default)

File size: Highly compressed, columnar

SQL

Best for:
- Database import
- Reproducible data loading
- Backup/migration
- Database seeding

Configuration options:

Database:
- PostgreSQL
- MySQL
- SQL Server
- SQLite
- Generic SQL

Statement Type:
- INSERT - Individual inserts
- BULK INSERT - Batch inserts
- COPY - PostgreSQL fast load
- LOAD DATA - MySQL fast load

Options:
- ☑ CREATE TABLE statement
- ☑ DROP TABLE IF EXISTS
- ☑ Transaction wrapper
- Batch size: 1000 rows
- Schema name: public

Example output:

CREATE TABLE customers (
    id INTEGER PRIMARY KEY,
    name TEXT NOT NULL,
    email TEXT
);

INSERT INTO customers VALUES (1, 'Alice', 'alice@example.com');
INSERT INTO customers VALUES (2, 'Bob', 'bob@example.com');

PDF Report

Best for:
- Printable reports
- Executive summaries
- Formal documentation
- Non-editable sharing

Configuration options:

Content:
- Data table (first 1000 rows)
- Quality summary
- Charts and visualizations
- Analysis notes

Layout:
- Page size: Letter, A4, Legal
- Orientation: Portrait, Landscape
- Margins: Normal, Narrow, Wide

Styling:
- Header/footer
- Company logo (upload)
- Color scheme
- Font selection

File size: Largest, formatted

Export Destinations

Save to File

Most common option:

1. Choose format
2. Click "Export to File"
3. Select save location
4. Enter filename
5. Export starts

File saved to:
- Your chosen location
- Default: ~/Downloads/rangerio_export_YYYY-MM-DD.ext

Export to Database

Direct database export:

1. Choose "Export to Database"
2. Enter connection details:
   Type: PostgreSQL Host: localhost Port: 5432 Database: mydb Table: customers (new or existing)
3. Choose mode:
4. Create new table
5. Replace existing table
6. Append to existing table
7. Export

Connection saved for future exports.

Copy to Clipboard

Quick copy for pasting:

1. Choose format (CSV, JSON, Markdown)
2. Click "Copy to Clipboard"
3. Data copied instantly
4. Paste into other application

Limitations:
- Limited to ~10,000 rows
- No file saved
- Lost when clipboard cleared

Advanced Export Options

Filtering During Export

Export subset of data:

Column selection:
- ☑ Choose specific columns
- Reorder columns
- Rename for export

Row filtering:

Condition: revenue > 1000 AND region = 'West'
Result: Only matching rows exported

Sampling:
- First N rows
- Random sample (%)
- Every Nth row

Incremental Export

Export only changes:

1. Enable "Incremental Export"
2. Choose tracking method:
3. Timestamp column (modified_date)
4. Version number
5. Change detection
6. First export: All data
7. Subsequent exports: Only new/changed rows

Use cases:
- Daily data sync
- Change feeds
- Audit logs

Scheduled Exports

Automate recurring exports:

1. Configure export as usual
2. Enable "Schedule Export"
3. Set schedule:
4. Daily at specific time
5. Weekly on specific day
6. Monthly on specific date
7. Custom cron expression
8. Choose destination:
9. File (with date in filename)
10. Database (append mode)
11. Network location

Notifications:
- Email on completion
- Log file created
- Error alerts

Batch Export

Export multiple sources at once:

1. Select multiple data sources (Ctrl/Cmd+click)
2. Click "Batch Export"
3. Choose:
4. Separate files (one per source)
5. Combined file (merged)
6. Zip archive (all files bundled)
7. Export all

Naming:
- source_name_YYYY-MM-DD.ext
- Custom naming template
- Sequential numbering

Export Quality

Pre-Export Validation

Before exporting, RangerIO checks:

Data Quality:
- Quality score meets threshold (configurable)
- No critical issues
- PII handled appropriately

Schema Validation:
- Column types compatible with format
- No invalid characters in column names
- Length limits respected (e.g., Excel 1M rows)

Format Compatibility:
- Special characters handled
- Date formats valid
- Encoding supported

Warnings shown if issues detected:
- 🟡 "Data quality below threshold (C grade)"
- 🟡 "PII detected in 3 columns - review before sharing"
- 🟡 "Dataset exceeds Excel row limit, consider CSV"

Post-Export Verification

After export completes:

Verification report:
- ✅ Rows exported: 1,234 of 1,234
- ✅ Columns exported: 15 of 15
- ✅ File size: 2.3 MB
- ✅ Export time: 3.2 seconds
- ✅ Checksum: a3d5f... (for integrity)

Actions:
- 📂 Open containing folder
- 👁️ Preview exported file
- ✉️ Share via email (if configured)
- 🔄 Re-export with changes

Sharing Exports

Best Practices

Before sharing externally:

1. ✅ Remove PII - Use Prepare Wizard
2. ✅ Check quality - Ensure high grade
3. ✅ Add documentation - Include README
4. ✅ Set sensitivity level - Mark as Internal/Public
5. ✅ Review sample - Spot check data

File naming:
- Include date: customer_data_2024-01-15.csv
- Version if applicable: sales_v2.xlsx
- Avoid spaces: Use underscores or hyphens

Documentation to include:
- Data dictionary (column descriptions)
- Collection date/source
- Known limitations
- Contact for questions

Secure Sharing

For sensitive data:

Encryption:
- Zip with password
- 7-Zip AES-256 encryption
- GPG encryption (for tech users)

Access control:
- Share via secure portal (not email)
- Set expiration date
- Track downloads
- Require authentication

Audit trail:
- Log who exported
- Log who accessed
- Include in export metadata

Export Templates

Creating Templates

Save export configurations for reuse:

1. Configure export with all settings
2. Click "Save as Template"
3. Name template: "Monthly Sales Report"
4. Template saved

Template includes:
- Format and options
- Column selection
- Filtering rules
- Destination settings

Using Templates

Apply saved template:

1. Click "Export"
2. Choose "Use Template"
3. Select template from list
4. Apply
5. Optionally modify before exporting

Use cases:
- Recurring reports
- Standardized exports
- Team collaboration
- Compliance requirements

Sharing Templates

Export template definition:
- JSON file with configuration
- Share with team members
- Import into their RangerIO

Team consistency:
- Everyone uses same settings
- Standardized output format
- Reduces errors

Troubleshooting

Common Export Issues

"Export failed: Out of memory"
- Dataset too large for available RAM
- Solution: Export in batches or use streaming formats (CSV, JSON Lines)

"Invalid characters in filename"
- Special characters not allowed
- Solution: Use alphanumeric, underscore, hyphen only

"Database connection failed"
- Network issue or wrong credentials
- Solution: Test connection, verify credentials, check firewall

"Excel row limit exceeded"
- Excel max: 1,048,576 rows
- Solution: Export as CSV or split into multiple files

"File already exists"
- Destination file already present
- Solution: Choose overwrite, rename, or cancel

Performance Tips

For large exports (>1GB):
- Use Parquet (smaller, faster)
- Enable compression
- Export to SSD, not network drive
- Close other applications

For many columns (>100):
- Select only needed columns
- Use CSV (simpler format)
- Avoid Excel (formatting overhead)

For slow databases:
- Use batch mode
- Increase batch size
- Export during off-peak hours
- Consider caching data locally first

Export Limits

Format-Specific Limits

* Limited by available disk space and RAM
† For readability; not technical limit

Recommended Limits

For best performance:
- Single file: <1GB
- Multiple files: Split at 500MB each
- Row count: <10 million per file
- Columns: <1000 per file

If exceeding:
- Split by date range
- Split by category
- Use database export (no file size limit)
- Use streaming export

Compliance & Governance

Audit Logging

Every export is logged:
- Timestamp
- User (if multi-user)
- Data source
- Format
- Rows/columns exported
- Destination
- Quality score at export time

Log location:
- Project folder: exports/export_log.csv
- Searchable and filterable

Data Lineage

Track data provenance:
- Original source
- Import date
- Transformations applied
- Quality improvements
- Export date
- Recipients (if recorded)

Lineage file:
- Included with export (optional)
- JSON format
- Machine and human readable

Compliance Features

GDPR / Privacy:
- PII detection and removal
- Right to deletion (delete before export)
- Data minimization (select only needed columns)

HIPAA:
- De-identification tools
- Audit trails
- Encryption support

SOX / Financial:
- Tamper-evident exports
- Version control
- Change tracking

Custom:
- Add compliance metadata
- Include attestations
- Watermark exports