Filter Pipeline
The filter pipeline is a crucial component that safeguards specific pipeline parts during data retrieval, consolidation, and transformation. It acts as a predicate function within the query pipeline flow control, allowing only the desired data to pass through. Unlike other pipelines, the filter pipeline performs no data retrieval, consolidation, or transformation logic. Its primary purpose is to selectively filter and control the data flow based on specific conditions or criteria.
Condition is a query structure that simulates a model query and allows you to do a predicate test on a given data set.
{
"condition": {
"id": {
"lt": 3
},
"name": {
"includes": "ob"
}
}
}
In this example data will pass a filter condition only if the field id is greater than 3 and name includes string “ob”
{
"id": 4,
"name": "Bob"
}
The only difference form you regular sync query is that this query executes without data source. By default query syntax is defined by Syncraft Query Language.