Data Interchange DSL

From OS.bee documentation
Revision as of 10:18, 4 August 2017 by Wu (Talk | contribs) (Configuration Settings / Smooks Framework (A small introduction))

Jump to: navigation, search

A general introduction and some high-level concepts for OSBP DSLs can be found in OSBP DSL Documentation.

Please note that you can only make use of the Datainterchange DSL by downloading its packages from the download section of our website.


The Data Interchange DSL (datainterchange for short) is made for defining data exchange models that can be used to import data from various formats (CSV, XML, EDI, etc.), map the data to entities, store them into database, or export them back into other formats.

You only need to define the relationship between the file and the bean, not the import / export process themselves. Once defined, these models can be used in e.g. action DSL to define actions which, when triggered, execute the actual import / export process, which are generated automatically by the OSBP based on the model.


Figure 1: - Data Interchange Structure.

As shown in Figure 1, the DSL inferrer will generate various views and In/Export component according to model described by datainterchange DSL (and action DSL, in the case of ActionButtons). The action buttons, when clicked, will trigger their corresponding In/Export processes by putting WorkerThreadRunnable jobs into the executor job pool within the TriggerView (prefixed with datainterchang name), buttons (and toolbar / menus containing them) are further included in the perspective.

Data Interchange Model File

Datainterchange DSL model files end with the .data extension. Data Interchange models may be split into several .data files, as long as they have the same package declaration.

Reserved Keywords

In the following we’ll dive deeper into the description and the usage of Datainterchange related and reserved keywords.


In the import section are all entities to be found - as full qualified names – that are currently used in the DSL and automatically imported/added (OXImportDeclaration) by editing it.

import ns net.osbee.sample.<ApplicationName>.entities.SampleEntity1
import ns net.osbee.sample.<ApplicationName>.entities.SampleEntity2
import ns net.osbee.sample.<ApplicationName>.entities.SampleEntity3


Datainterchange DSL model files must start with a package declaration. Packages are the root element of the DSL grammar and must be defined as follow package <PackageName> for example

package net.osbee.sample.ApplicationName.datainterchanges { }

Data Interchange models may be split into several .data files, as long as they have the same package declaration.

package net.osbee.sample.<applicationname>.datainterchanges title "<titletext>" {
    interchange <interchangename> persist file
    <fileformat> "<filepath>" [<further specifications>]
    beans {
        <entity relationships>


With the keyword title you can give a name to the corresponding TriggerView dialog inside your application. For example the definition of the same datainterchanges package from above with the title DataInterchange

package net.osbee.sample.foodmart.datainterchanges title "DataInterchange" {}

You can get more details about the TriggerView in the section below.


All interchange units have to be defined in the package followed by the Entity they are referencing/applied to.

interchange <SampleInterchangeUnitName> <EntityManagerMode> <FileFormat> {}


With this keyword you get to set the optional description of an interchange unit as shown below.

interchange <SampleInterchangeUnitName> describedBy "This is a description of the Datainterchange DSL Unit EntityName"  {}

persist, merge, remove

With those keywords defined inside the Enum Entity Manager Mode, you set how the data have to be process by inserting then into a database.

interchange <SampleInterchangeUnitName> <EntityManagerMode>  {}
Example 1:
interchange SampleInterchangeUnit1 merge  {}
Example 2:
interchange SampleInterchangeUnit2 persist  {}
Example 3:
interchange SampleInterchangeUnit3 remove  {}


With the keyword file you are able to set the file format of the files you intent to process with you interchange unit.

interchange <SampleInterchangeUnitName> <EntityManagerMode> file <FileNameFormat> {}

The current supported file formats are CSV, EDI and XML followed by the name of the file you want to process, given its full path location in the system.

Example 1:
interchange SampleInterchangeUnit1 merge file CSV "C:/temp/testFile.csv {}
Example 2:
interchange SampleInterchangeUnit2 persist file XML "C:/temp/testFile.xml {}
Example 3:
interchange SampleInterchangeUnit3 merge file EDI "C:/temp/testFile.edi {}

After choosing the file format you can either give the file name as a String value in a double quote "..." as shown here above, or hold Ctrl+Space to get the option of opening a File Chooser/Picker to specify the file you want to work with.

Figure 2: File Chooser


With the keyword elementSize followed by a number between 0 and 100 ? you set the average size of the file (or set of data).

interchange SampleInterchangeUnitName merge elementSize 50 file CSV "C:/temp/testFile.csv {}


With the keyword delimiter you set the delimiter/separation character of the file.

interchange SampleInterchangeUnitName merge elementSize 50 file CSV "C:/temp/testFile.csv” delimiter ";" {}


With the keyword skipLines followed by a number you specify the number of line to be skipped or not to be considered in the processing of the selected file.

interchange SampleInterchangeUnitName merge elementSize 50 file CSV "C:/temp/testFile.csv” delimiter ";" skipLines 1 {}







With the keyword entity you specify the Entity on what the interchange unit is based on.

interchange SampleInterchangeUnit1 merge elementSize 50 file CSV "C:/temp/testFile.csv” delimiter ";" skipLines 1 {
entity SampleEntity1  {} 

For more information about Entities you can review the corresponding Entity DSL documentation.



expression -> assign | copy |


keys -> key


mapping ->




Enums are an abstraction of the Java enum. They compile to enum classes and can be used as properties in entities and beans.

Figure 3: Defining enums allows using them as variables in entities and beans.

The Datainterchange DSL provides 3 Enum types that can be used: PredefinedBeanEnum, PredefinedBeanTypeEnum, ProgessBarStyleEnum and the EntityManagerMode.


Contains the definition of the values now(NowDate) | start(StartDate) | UUID(UniversallyUniqueIdentifier) used for ...


Contains the definition of the values Date(Date) | Millis(Milliseconds) | Nanos(Nanoseconds) | random(Random) | execContext(ExecuteContext) used for ...


Contains the definition of the values none(none) | normal(normal) | important(important) used for setting the style of a progressbar.


Contains the definition of the values persist(persist) | merge(merge) | remove(remove) used for specifying the Entity Manager Mode in order to decide how to manage data inside a database before committing any changes.

Configuration Settings / Smooks Framework (A small introduction)

The OS.bee implementation of Data Interchange interface is based on Smooks. Smooks is a Java framework for processing XML and non XML data (CSV, EDI, Java etc) by mapping data to JavaBeans, which can later be persisted, enriched (merge with existing data from other source), or converted and exported into other formats.

Smooks relies on a proper configuration file for the import / export process, these config files are generated by the datainterchange DSL automatically. Here is a brief introduction of how the generated Smooks configuration files work.

When a data import / export Smooks instance is initiated, it will be supplied with the generated config file. This file defines the actions to be performed upon certain events during the SAX parsing process. Here is an example:

 1 <?xml version="1.0" encoding="UTF-8" standalone="no"?>
 2 <smooks-resource-list xmlns="" xmlns:csv="" xmlns:dao="" xmlns:jb="">
 3     <jb:bean beanId="McurrencyNameStream" class="net.osbee.sample.foodmart.entities.McurrencyNameStream" createOnElement="/csv-set">
 4         <jb:expression property="importDate">PTIME.nowDate</jb:expression>
 5         <jb:wiring beanIdRef="McurrencyName" setterMethod="addToCurrencyNames"/>
 6     </jb:bean>
 7     <jb:bean beanId="McurrencyName" class="net.osbee.sample.foodmart.entities.McurrencyName" createOnElement="/csv-set/csv-record">
 8         <jb:value data="/csv-set/csv-record/isoCode" decoder="String" property="isoCode"/>
 9         <jb:value data="/csv-set/csv-record/name" decoder="String" property="name"/>
10         <jb:value data="/csv-set/csv-record/countries" decoder="String" property="countries"/>
11     </jb:bean>
12     <csv:reader fields="isoCode,name,countries" indent="false" separator=";" skipLines="1"/>
13     <params>
14         <param name="stream.filter.type">SAX</param>
15         <param name="inputType">input.csv</param>
16         <param name="smooks.visitors.sort">false</param>
17         <param name="input.csv" type="input.type.actived">C:/git/net.osbee.sample.foodmart/net.osbee.sample.foodmart.datainterchange/smooks-resources/ISOCurrencyCodes081507.csv</param>
18     </params>
19 </smooks-resource-list>



Smooks (Extended)

just links???

WorkerThread (Runnable)


TriggerView & Executorservice

DSL Inferrer

DSL Scope Provider

DSL Proposal Provider

DSL Validator

Copyright Notice

All rights are reserved by Compex Systemhaus GmbH. In particular, duplications, translations, microfilming, saving and processing in electronic systems are protected by copyright. Use of this manual is only authorized with the permission of Compex Systemhaus GmbH. Infringements of the law shall be punished in accordance with civil and penal laws. We have taken utmost care in putting together texts and images. Nevertheless, the possibility of errors cannot be completely ruled out. The Figures and information in this manual are only given as approximations unless expressly indicated as binding. Amendments to the manual due to amendments to the standard software remain reserved. Please note that the latest amendments to the manual can be accessed through our helpdesk at any time. The contractually agreed regulations of the licensing and maintenance of the standard software shall apply with regard to liability for any errors in the documentation. Guarantees, particularly guarantees of quality or durability can only be assumed for the manual insofar as its quality or durability are expressly stipulated as guaranteed. If you would like to make a suggestion, the Compex Team would be very pleased to hear from you.

(c) 2016-2021 Compex Systemhaus GmbH