Data Transformation
Exceptional search begins with exceptional data
Streamline data preparation and elevate data quality — automatically cleaning, structuring, and optimising records before they reach your search index.
Transform your data with precision and speed
Code editor
Write, test, and deploy transformation logic in a full-featured code edir with intelligent autocomplete, real-time data sampling, and built-in debugging tools. See exactly how your transformations affect live records before pushing to production.
AI-assisted data transformations
Describe what you need in plain language, and bCloud AI will automatically generate the transformation logic for you. Review the output in the dashboard, refine if needed, and apply — no manual coding required for most common operations.
No-code transformations
Quickly validate your implementation, test different prompts, and fine-tune response quality in a visual sandbox environment — before deploying a single line of code to production.
Connect to any data source
Advanced Markdown indexing and intelligent content segmentation ensure your documents are processed with optimal granularity — improving context retention and delivering significantly more accurate responses.
Use cases and strategies with Data Transformation
Apply any transformation at the record level — no code required
Add new attributes such as tags, categories, and labels. Remove unnecessary fields to reduce index bloat. Filter records based on conditional logic. Change data types, reformat date strings, normalise text casing, and more — all configurable through the visual editor without engineering intervention.
Compute and derive complex attributes
Calculate discount percentages from original and sale prices. Normalise product attributes across different supplier formats. Apply gravity or decay scoring models for time-sensitive content. Add weighting values for custom ranking formulas. Convert flat lists of categories into hierarchical structures that power faceted navigation.
Data Transformation FAQs
What is Data Transformation in bCloud AI?
Data Transformation lets you clean, enrich, and standardise your records before or after they’re indexed in bCloud AI. It ensures your data is consistent, well-structured, and optimised for the best possible search and discovery experience — without requiring separate pre-processing infrastructure outside the platform.
Why should I use bCloud AI's Data Transformation instead of preprocessing my data externally?
You can connect any third-party API that returns data in a compatible format. Common integrations include translation services like DeepL and Google Translate, payment platforms like Stripe, CRM systems like HubSpot and Salesforce, weather services like OpenWeather, LLM providers like OpenAI and Anthropic, and even your own custom internal APIs. If it has an endpoint, Sync can call it.
What types of transformations can I apply?
You can normalise text (casing, trimming whitespace, accent folding), combine or split fields, generate computed attributes (discount percentages, weighted scores, hierarchical categories), remove unwanted fields, filter records by conditions, convert data types, and enrich records with AI-generated metadata. The system supports both visual configuration and custom code for maximum flexibility.
Do I need to write code to use Data Transformation?
No coding is required for most common transformations. bCloud AI provides both a visual no-code editor for business users and an AI-assisted mode where you describe transformations in plain language. Developers also have access to a full code editor with autocomplete, sampling, and debugging capabilities for more complex or custom logic.
Can I preview or test transformations before applying them to production?
Yes. You can preview transformations on sample records before pushing changes live — ensuring accuracy and preventing errors from reaching your production index. The code editor includes real-time sampling so you can see exactly how each transformation affects your data before deployment.
How does Data Transformation impact indexing speed and performance?
Transformations run at indexing time within bCloud AI’s optimised infrastructure. The process is designed to handle large datasets efficiently without adding perceptible latency to your search queries. Your end users experience the same sub-15ms response times regardless of transformation complexity.
Is Data Transformation secure?
Yes. All transformations execute within bCloud AI’s secure, SOC 2-compliant infrastructure. Your data never leaves the platform during transformation, and access controls follow your existing bCloud AI permissions. Every operation is logged and auditable for full compliance visibility.