logo_smallAxellero.io

Data & Storage

Nodes for data transformation, file management, and transaction control in workflows.

Data & Storage

Nodes for data transformation, file operations, and transaction management within workflows. Provides data handling capabilities for automation processes.

Quick Navigation

Data Converter

Transform XML documents into JSON objects for easier processing

File Storage

Upload, download, and manage files with presigned URLs and blob storage

Transaction

Manage database transaction boundaries with commit and rollback operations

Available Nodes

NodeCodePurposeUse Cases
Data ConverterdataconverterConvert XML to JSON objectsAPI integration, data transformation, format conversion
File StoragefilestorageFile upload, download, and managementDocument workflows, file processing, content storage
TransactiontransactionDatabase transaction controlAtomic operations, data consistency, rollback scenarios

Architecture Overview

Data Flow Patterns

┌─────────────────┐    ┌──────────────────┐    ┌─────────────────┐
│   XML Source    │───▶│ Data Converter   │───▶│ JSON Processing │
└─────────────────┘    └──────────────────┘    └─────────────────┘

┌─────────────────┐    ┌──────────────────┐    ┌─────────────────┐
│  File Upload    │───▶│ File Storage     │───▶│ File Processing │
└─────────────────┘    └──────────────────┘    └─────────────────┘

┌─────────────────┐    ┌──────────────────┐    ┌─────────────────┐
│ DB Operations   │───▶│ Transaction      │───▶│ Commit/Rollback │
└─────────────────┘    └──────────────────┘    └─────────────────┘

Integration Patterns

Workflow Integration

Data & Storage nodes integrate with other node groups:

  • Core nodes for workflow control and context access
  • Integration nodes for external system connectivity
  • Code Execution nodes for custom data processing logic

Common Use Cases

Document Processing Pipeline

Transform XML documents, store intermediate files, and manage transaction boundaries:

  1. Data Converter → Convert incoming XML to JSON
  2. File Storage → Save processed documents
  3. Transaction → Ensure atomicity of multi-step operations

API Data Integration

Handle XML-based APIs with file attachments:

API Response (XML) → Data Converter → JSON Processing → File Storage

File Management Workflows

Upload, process, and store files with transactional safety:

File Upload → File Storage → Processing → Transaction Control

Getting Started

XML to JSON Conversion

Start with converting XML documents to JSON for easier data processing

File Upload/Download

Learn file storage operations with presigned URLs and blob management

Transaction Management

Implement atomic operations with commit and rollback capabilities

Best Practices

Best Practices

  1. Validate data formats before conversion operations
  2. Use transactions for multi-step data operations requiring atomicity
  3. Monitor file sizes and implement appropriate limits
  4. Handle errors with proper rollback mechanisms
  5. Secure file access using presigned URLs and authentication

Advanced Integration Patterns

Cross-Node Workflows

Node Combinations

Data & Storage nodes can be combined in workflows for complete data processing pipelines.

Complete Document Processing Pipeline:

XML API Response → Data Converter → File Storage → Transaction Control

Secure File Upload with Database Tracking:

File Upload → File Storage → Database Record → Transaction Commit/Rollback

Bulk Data Import with Validation:

CSV Upload → File Storage → Data Converter → Batch Processing → Transaction Control

Workflow Context

Learn how to access and pass data between nodes using ctx object

Code Execution

Custom data processing logic with JavaScript and Python

Integration Nodes

Connect with external systems and APIs

Database Operations

Execute SQL commands and database operations

Next Steps: Explore individual node documentation for detailed implementation examples and configuration options.