Later the performance went down and we could not load the data on time. Things went bad.
All I saw is the first three CPUs were used by the system and not the rest of the CPUs.
With a lot of investigation between HP & Oracle , it was finally discovered to be the NUMA setup within Oracle Code to use the first cell board and ignore the rest.
alert.log looked like the below for NUMA configuration
and NUMA PG = 3, CPUs = 3
Statement from Oracle was "NUMA is turned on by default 10.2.0.4 and as per the observation only 3 CPU is used."
Later the Init.ora parameter were setup to disable the NUMA.
_enable_numa_optimization=FALSE
_db_block_numa=1
Database was restarted and we were able to see the Oracle processes working on all the 10 CPUS.
Now the alert.log will showed like
and NUMA PG = 1, CPUs = 10
I hope this information will help HP Customers running Oracle Database.