A Dataflow Meta—Computing Framework for Event Processing in the H1 Experiment

在线阅读 下载PDF 导出详情
摘要 LinuxbasednetworkedPCsclustersarereplacingboththeVMEnonuniformdirectmemoryaccesssystemsandSMPsharedmemorysystemsusedpreviouslyfortheonlineeventfilteringandreconstrucion.ToallowanoptimaluseofthedistributedresourcesofPCclustersanopensoftwareframeworkispresentlybeingdevelopedbasedonadataflowparadigmforeventprocessing.Thisframeworkallowsforthedistributionofthedataofphysicseventsandassociatedcalibrationdatatomultiplecomputersfrommultipleinputsourcesforprocessingandthesubsequentcollectionoftheprocessedeventsatmultipleoutputs.Thebasisofthesystemistheeventrepository,basicallyafirst-infirst-outeventstorewhichmaybereadandwritteninamannersimilartosequentialfileaccess.Eventsarestoredinandtransferredbetweenrepositoriesassuitablylargesequencestoenablehighthroughput.Multiplereaderscanreadsimultaneouslyfromasinglerepositorytoreceiveeventsequencesandmultiplewriterscaninserteventsequencestoarepository,Hencerepositoriesareusedforeventdistributionandcollection.Tosupportsynchronisationoftheeventfolowtherepositoryimplementsbaaiers.Abarriermustbewrittenbyallthewritersofarepositorybeforeanyreadercanreadthebarrier,Areadermustreadabarrierbeforeitmayreceivedatafrombehindit.Onlyafterallreadershavereadthebarrieristhebarrieremovedfromtherepository.Abarriermayalsohaveattacheddata,Inthiswaycalibrationdatacanbedistributedtoallproessuingunits.Therepositoriesareimplementedasmulti-threadedCORBAobjectsinC++andCORMAisusedforalldatatransfers,JobsetupscriptsarewritteninpythonandinteractivestatusandhistogramdisplayisprovidedbyaJavaprogram.JobsrununderthePBSbatchsystemprovidingshareduseofresourcesforonlinetriggering,offlinemassreporcessinganduseranalysisjobs.
机构地区 不详
出版日期 2001年01月11日(中国期刊网平台首次上网日期,不代表论文的发表时间)
  • 相关文献