Labels

_fuxi (75) _IV (146) _misc (5) {610610 (30) algo (1) automatedTrading (8) banking/economy (3) book (14) c++misc (125) c++real (15) c++STL/java_container (7) cppTemplate (1) db (13) DB_tuning (4) deepUnder (1) dotnet (69) eTip (17) excelVBA (12) finance+sys (34) financeMisc (24) financeRisk (2) financeTechMisc (4) financeVol (21) finmath (17) fixedIncome (25) forex (16) IDE (24) invest (1) java (43) latency (4) LinearAlgebra (3) math (30) matlab (24) memoryMgmt (11) metaPrograming (2) MOM (15) msfm (1) murex (4) nofx (11) nosql (3) OO_Design (1) original_content (4) scriptUnixAutosys (19) SOA (7) socket/stream (15) sticky (1) subquery+join (2) swing (32) sybase (6) tech_orphan (12) tech+fin_career (30) telco (11) thread (21) timeSaver (13) tune (10) US_imm (2) US_misc (2) windoz (20) z_algo+dataStructure (4) z_arch (2) z_c#GUI (30) z_career (10) z_career]US^Asia (2) z_careerBig20 (1) z_careerFinanceTech (11) z_FIX (6) z_forex (31) z_hib (2) z_ikm (7) z_inMemDB (3) z_j2ee (10) z_oq (14) z_php (1) z_py (26) z_quant (4) z_skillist (3) z_spr (5)

Thursday, August 2, 2012

coherence Q&A

What is coherence used for in a typical project? What kind of financial data is cached?
[BTan] position data, booking, product data, (less important) market data

[BTan] Coherence could in theory be a market data subscriber.

Why those data need to be cached?
[BTan] replication, cluster failover

Do we know the cached data's structure already before caching them? [BTan] (yes) ( for instance, are they predefined JAVA beans ), is POFSerilizer used ([BTan] no) or are they implementing Portableobject ([BTan] yes) and registered with pof-config.xml ([BTan] yes)? Why one is chosen over the other?
[BTan] we have huge business objects. rooted hierarchy

Do the data have a life cycle?
[BTan]  no

How do coherence know if the data expired and remove them?
[BTan]  http://download.oracle.com/otn_hosted_doc/coherence/341/com/tangosol/net/cache/CacheMap.html#put(java.lang.Object, java.lang.Object, long)

Why do people need coherence? For performance or for large data caching purpose?
[BTan]  both

How many coherence nodes are installed on how many servers?
[BTan]  60 nodes on 6 machines 16GB / machine

What is the magnitude we are looking at?
[BTan]  at least 12GB of base data. Each snap takes 12GB+. Up to 5 snaps a day.

Why that many servers are needed?
[BTan]  machine failover

is it constrained by the individual server's memory? How to define a coherence node's size?
[BTan]  1G/node

What is the topology of the coherence architecture? Why is it designed that way?
[BTan]  private group communication

Is it Multicasting or WKA? Why is it designed in that way?
[BTan]  multicast, because internal network

How do you do the trouble-shooting? Do you have to check the log file, where are those log files?
[BTan]  JMX monitor + logs on NAS storage