Skip to main content

Pushdown optimization and types in Informatica


The types of pushdown optimization:

Source-side pushdown optimization. The Integration Service pushes as much transformation logic as possible to the source database.

Target-side pushdown optimization. The Integration Service pushes as much transformation logic as possible to the target database.

Full pushdown optimization. The Integration Service attempts to push all transformation logic to the target database. If the Integration Service cannot push all transformation logic to the database, it performs both source-side and target-side pushdown optimization.

Running Source-Side Pushdown Optimization Sessions

When you run a session configured for source-side pushdown optimization, the Integration Service analyzes the mapping from the source to the target or until it reaches a downstream transformation it cannot push to the source database.

The Integration Service generates and executes a SELECT statement based on the transformation logic for each transformation it can push to the database. Then, it reads the results of this SQL query and processes the remaining transformations.

Running Target-Side Pushdown Optimization Sessions

When you run a session configured for target-side pushdown optimization, the Integration Service analyzes the mapping from the target to the source or until it reaches an upstream transformation it cannot push to the target database. It generates an INSERT, DELETE, or UPDATE statement based on the transformation logic for each transformation it can push to the target database. The Integration Service processes the transformation logic up to the point that it can push the transformation logic to the database. Then, it executes the generated SQL on the target database.

Running Full Pushdown Optimization Sessions

To use full pushdown optimization, the source and target databases must be in the same relational database management system. When you run a session configured for full pushdown optimization, the Integration Service analyzes the mapping from the source to the target or until it reaches a downstream transformation it cannot push to the target database. It generates and executes SQL statements against the source or target based on the transformation logic it can push to the database.

When you run a session with large quantities of data and full pushdown optimization, the database server must run a long transaction. Consider the following database performance issues when you generate a long transaction:

A long transaction uses more database resources.

A long transaction locks the database for longer periods of time. This reduces database concurrency and increases the likelihood of deadlock.

A long transaction increases the likelihood of an unexpected event.

To minimize database performance issues for long transactions, consider using source-side or target-side pushdown optimization.

Integration Service Behavior with Full Optimization

When you configure a session for full optimization, the Integration Service analyzes the mapping from the source to the target or until it reaches a downstream transformation it cannot push to the target database. If the Integration Service cannot push all transformation logic to the target database, it tries to push all transformation logic to the source database. If it cannot push all transformation logic to the source or target, the Integration Service pushes as much transformation logic to the source database, processes intermediate transformations that it cannot push to any database, and then pushes the remaining transformation logic to the target database. The Integration Service generates and executes an INSERT SELECT, DELETE, or UPDATE statement for each database to which it pushes transformation logic.

The Rank transformation cannot be pushed to the source or target database. If you configure the session for full pushdown optimization, the Integration Service pushes the Source Qualifier transformation and the Aggregator transformation to the source, processes the Rank transformation, and pushes the Expression transformation and target to the target database. The Integration Service does not fail the session if it can push only part of the transformation logic to the database.

Comments

Popular posts from this blog

Top 100 Informatica Interview Questions

I have attended Informatica interview last week in wipro and couple of other companies, Question below I faced in those companies. 1. What are the main issues while working with flat files as source and as targets ? 2. Explain about Informatica server process that how it works relates to mapping variables? 3. write a query to retrieve the latest records from the table sorted by version(scd) 4. How do you handle two sessions in Informatica 5. which one is better performance wise joiner or look up 6. How to partition the Session? 7. How many types of sessions are there in informatica.please explain them. 8. Explain the pipeline partition with real time example? 9. Explain about cumulative Sum or moving sum? 10. CONVERT MULTIPLE ROWS TO SINGLE ROW (MULTIPLE COLUMNS) IN INFORMATICA 11. DEPLOYMENT GROUPS IN INFORMATICA 12. LOAD LAST N RECORDS OF FILE INTO TARGET TABLE - INFORMATICA 13. LOAD ALTERNATIVE RECORDS / ROWS INTO...

Configuring the Evaluate Function in OBIEE 12C

/obiee/MW/instances/instance1/config/OracleBIServerComponent/coreapplication_obis1 Change the value of EVALUATE_SUPPORT_LEVEL =0 as below EVALUATE_SUPPORT_LEVEL: 1: evaluate is supported for users with manageRepositories permssion 2: evaluate is supported for any user. other: evaluate is not supported if the value is anything else. EVALUATE_SUPPORT_LEVEL = 2; Configuring Maximum number of records not done for odi server Configuring Maximum number of records Exceeded configured maximum number of allowed input records. Added tags in Instanceconfig.xml file. Steps : 1. login into EM 2.stop the opmn services 3.go to path /obiee/FMW/instances/instance1/config/OracleBIPresentationServicesComponent/coreapplication_obips1 4.edit the instanceconfig.xml file using vi command 5. Add bellow line under views tags <MaxVisibleColumns>30000</MaxVisibleColumns> <MaxVisiblePages>2500000</MaxVisiblePages> <MaxVisibleRows>65000</MaxVisibleRows> <MaxVisib...

OBIEE 11g dumps

I have cleared OBIEE 11g certification exam (1z0-591) exam yesterday, It was damn easy when compared to OBIEE 10g certification. I have referenced oracle PDF and some of the other OBIEE dumps. I remember some of the question which came in exam. I will publish those question very soon