Thursday, March 16, 2017

Oracle OIM Server and Design Console

OIM Server and Design consoles:

ConsolesAccess URLs
Checking the Oracle Identity Manager Server Web Console URL http://<host>:14000/oim
Checking the Oracle Identity Manager Server Scheduler Engine URL http://<host>:14000/SchedulerService-web
Checking the OIM Diagnostic Dashboard utility URL http://v:14000/XIMDD
Checking the OIM Weblogic Admin Console URL http://<host>:7001/console
Checking the OIM EM console URL http://<host>:7001/em
Checking the SOA Infrastructure URL http://<host>:8001/soa-infra/
Checking the BPEL Worklist application URL http://<host>:8001/integration/worklistapp

Thursday, January 26, 2017

Apache Storm - Custom Bolt

Apache Storm is open source distributed computing system. Storm can be used for - Streaming  Data, Realtime Data Processing and Distributed Messaging ...

In one of my assignment am using Storm for streaming data (one of Storm main feature). Requirement was to stream CDR (Call Data Records) file data to HDFS. As calls originate from different regions, data records has to go to directory in HDFS corresponding to region of call origination.
eg: consider a call records from Karnataka (KA) will be written to directory: <PARETN_DIR>/state=NAME in HDFS.

Later i can define a hive table with state as partition fetch desired records.

To achieve data streaming to specific directory based on record content i chose to create a custom CDRHDFSBolt by extending HDFSBolt API provided by Storm. Except for writeTuple() method i kept all method untouched. I over wrote writeTuple() method to verify tuple content: if it has a value corresponding to desire state, then write tuple to HDFS else discard the tuple.

Bolt Class:
public class CDRHDFSBolt extends HdfsBolt{

    public void writeTuple(Tuple tuple) throws IOException{      
        String record = tuple.getString(0);
        String statename = tuple.getString(1);

Topology Class:

     HdfsBolt bolt = CDRHdfsBolt();
     FileNameFormat fileNameFormat = new DefaultFileNameFormat()

Note: set HDFS details to bolt.