Using the Bulk Load Utility in OIM 12c (12.2.1.3.0)

                            Using the Bulk Load Utility in OIM 12c (12.2.1.3.0)

The Bulk Load utility is aimed at automating the process of loading a large amount of data into Oracle Identity Manager. It helps reduce the downtime involved in loading data. You can use this utility after you install Oracle Identity Manager or at any time during the production lifetime of Oracle Identity Manager. The Bulk Load utility can load users, accounts, roles, role hierarchy, role membership, role category data, and organizations

Modes of Running the Utility

The Bulk Load utility can be run in one of the following modes:

Offline mode: This is the traditional or existing mode.

                         To run the utility in offline mode, Oracle Identity Manager must be down.

Online mode: In online mode, there is no need to shut down Oracle Identity Manager.

                         online mode only implies that the utility can be run when 

                         Oracle Identity Manager is  up and running. It is still a command-line

                         utility and no other interface is available for online mode.

By default, Bulk Load utility runs in online mode.

To choose between the online or offline mode, consider the following factors:

At times, service availability is more important for business reasons.

Choose default online mode in this case.

If volume of new entities loaded is not huge, cost of service restart and index rebuild after offline bulkload is higher than slight performance degradation in online mode. 

Choose default online mode in this case.

When load volume is high and existing system data is less in comparison, offline bulk load might have some advantages

Prerequisites to run the bulkload utility in OIM12C

Temporary table Space

While running the script, the script will create few temporary tables.

OIM_BLKLD_TMP_SUFFIX :  The script will first loads data from the CSV file into this table

OIM_BLKLD_EX_SUFFIX  : This table is used to hold data records that fail (are not loaded into Oracle Identity Manager) during a bulk load operation.

OIM_BLKLD_LOG : The utility inserts progress and error messages in the OIM_BLKLD_LOG table.

You can use either default OIM table space or separate table space to store these temporary tables. It is recommended to create and use a separate tablespace to store these temporary tables. If you want to use the OIM default table space, add space to this data file. You can add data file to oim database table space by running the oim_blkld_setup.sql script as explained below,

Login to OIM database as sysdba

Execute the oim_blkld_setup.sql

Enter the OIM default table space name

Name and full path of the data file to be added in OIM Database

Enter the OIM database username

Create OIM user to copy password

Login to OIM server and create a new user.

This password for this user will be copied as the default password for all the users created by oimbulkload utility.

Below is the location of oimbulkload in my case:-
1.)/u03/idm/server/db/oim/oracle/Utilities/oimbulkload

2.)In /u03/idm/server/db/oim/oracle/Utilities/oimbulkload/csv_files
    you should be able to see master.txt file and Readme.txt files
    projecta.csv file is file which we have created for loading user data

3.) In my case we have created the csv file with projecta.csv and placed file in 

     the csv_files directory with the user data to be loaded. 

4.)In master.txt file enter the name of csv file that should be used for
    loading user data and save in our case its projecta.csv

5.) Stop OIM server before running Bulk Load Utility

6.) Execute oim_blkld.sh script.

7.)Select the operation to perform bulkload utility
     Here in my case we re loading user data so selected option as 1,
     select option here as per your requirement and press enter

8.)Enter Database Details here as per location of db installaed
    In my case location is:-/u01/app/oracle/product/12.1.0/db_1 as ORACLE_HOME

    Press Enter     

9.)Once enter here it shows whether entered ORACLE_HOME is valid or not

10.)Here enter oim database connect string in following format
    //HostIPAddress:Port/ServiceName
    //HosIPAddress:1521/orcl  and click enter

11.)Enter Oracle Identity Manager (OIM) database user name
       In my case it is PROD_OIM provide db user name as per your requirement

12.)Once entered it will as to enter OIM DB user password twice
      Provide password twice and click on enter

13.)Enter password for OIM Db user again and click enter

14.)Select the input for user load as per your requirement.
      In my case we are loading users via CSV File so choosen option as 2 and enter

15.)Enter the name of the master file contining names of all csv files to be loaded

Enter name as master.txt and enter

16.)Enter the Name of tablespace to be used for creating custom objects,
      by utility [PROD_OIM],Press enter by default PROD_OIM will be selected.
17.)Enter the date format for data load:
      MM-DD-YYYY

18.)Enter batch size for processing defined size as per your
      requirement and press enter
19.)Do you wish to insert log msgs if yes provide value as Y and
      Enter and if no provide value as N and enter

20.)Enter User ID (USR_LOGIN),of the user created from web console
      provide value as xelsysadm and click enter

21.)Enter User ID (USR_LOGIN),of the user created from web console
      provide value as xelsysadm and click enter

Note:-Fix the issues with failed users and execute the utility again to load the failed users 
22.)Temporary Tables Created

       OIM_BLKLD_TMP_{FILE_SUFFIX} : Loads data from csv into this table

       OIM_BLKLD_EX_{FILE_SUFFIX}: Stores data records that fail during bulk load

       OIM_BLKLD_LOG: Logs errors and monitor progress

23.) Lets login to Identity Console and check the newly created users.