We present ADIOS 2, the latest version of the Adaptable Input Output (I/O) System. ADIOS 2 addresses scientific data management needs ranging from scalable I/O in supercomputers, to data analysis in ...personal computer and cloud systems. Version 2 introduces a unified application programming interface (API) that enables seamless data movement through files, wide-area-networks, and direct memory access, as well as high-level APIs for data analysis. The internal architecture provides a set of reusable and extendable components for managing data presentation and transport mechanisms for new applications. ADIOS 2 bindings are available in C++11, C, Fortran, Python, and Matlab and are currently used across different scientific communities. ADIOS 2 provides a communal framework to tackle data management challenges as we approach the exascale era of supercomputing.
Full text
Available for:
GEOZS, IJS, IMTLJ, KILJ, KISLJ, NLZOH, NUK, OILJ, PNG, SAZU, SBCE, SBJE, UILJ, UL, UM, UPCLJ, UPUK, ZAGLJ, ZRSKP
We present a real-time, full-frame, multi-target Wide Area Motion Imagery (WAMI) tracking system that utilizes distributed processing to handle high data rates while maintaining high track quality. ...The proposed architecture processes the WAMI data as a series of geospatial tiles and implements both process- and thread-level parallelism across multiple compute nodes. Each tile is processed independently, from decoding the image through generating tracks that are finally merged across all tiles by an inter-tile linker (ITL) module. A high performance PostgreSQL database with GIS extensions is used to control the flow of intermediate data between each tracking process. High quality tracks are produced efficiently due to robust, effective algorithmic modules including: multi-frame moving object detection and track initialization; tracking based on the fusion of motion and appearance with a goal of very pure tracks; and online track linking based on multiple features. In addition, we have configured a high-performance compute cluster using high density blade servers, Infiniband networking, and an HPC filesystem. The compute cluster enables full-frame, state-of-the-art tracking of vehicles or dismounts at the WAMI sensor's native 1.25Hz frame-rate, while only taking 7u of rack space and providing 210 megapixels/second throughput.
One of the core issues across computer and computational science today is adapting to, managing, and learning from the influx of "Big Data". In the commercial space, this problem has led to a huge ...investment in new technologies and capabilities that are well adapted to dealing with the sorts of human-generated logs, videos, texts, and other large-data artifacts that are processed and resulted in an explosion of useful platforms and languages (Hadoop, Spark, Pandas, etc.). However, translating this work from the enterprise space to the computational science and HPC community has proven somewhat difficult, in part because of some of the fundamental differences in type and scale of data and timescales surrounding its generation and use. We describe a forward-looking research and development plan which centers around the concept of making Input/Output (I/O) intelligent for users in the scientific community, whether they are accessing scalable storage or performing in situ workflow tasks. Much of our work is based on our experience with the Adaptable I/O System (ADIOS 1.X), and our next generation version of the software ADIOS 2.X 1.
Interview with U.S. Energy Secretary Jennifer Granholm. Former President Trump is back on the stage. Does the Republican Party need him or need him to go away? GUESTS: Jennifer Granholm, Chris ...Matthews, Anne Gearan, Lanhee Chen, Mark Warner, Roy Blunt, Lanhee Chen,
Interview with U.S. Secretary of State Antony Blinken. President Biden led an international "Summit for Democracy" this past week. But what if it's our democracy that's the one that's in trouble? ...GUESTS: Antony Blinken, Marianna Sotomayor, Brendan Buck
Interview with Sen. Joe Manchin (D-WV). President Biden is gambling that not only will his new vaccine mandate initiative be good health policy, but believes it's good politics. Is he right? GUESTS: ...Joe Manchin, Doris Kearns Goodwin, George Will
Chris Murphy Discusses the Support for Donald Trump in the Primaries and How His Indictment Seems to Have No Effect on His Voter Base; Trump's Republican Rivals Hesitant to Take on Trump for Fear of ...Alienating His Supporters; Will Hurd Discusses the Immigration Policy of the Biden Administration and the Border Security Situation at the Southern Border Following the End of Title 42; Florida Governor Ron DeSantis is on the verge of announcing his 2024 bid. Interview with Russell Moore, editor-in-chief of "Christianity Today". GUESTS: Chris Murphy, Will Hurd, Rachael Bade, Russell Moore
House Speaker Nancy Pelosi's husband Paul is attacked in their home, amid growing threats of political violence; Interview with Gov. Chris Sununu (R-NH). Threats against members of Congress are ...rising. GUESTS: Amy Klobuchar, Chris Sununu, Marianna Sotomayor, Brad Todd
Supreme Court draft opinion suggests overturning of Roe. GOP candidates lean on Trump playbook; Interview With Governor Tate Reeves (R-MS); Interview With Michigan Attorney General Dana Nessel ...GUESTS: Jennifer Mascott, Josh Gerstein, Tate Reeves, Dana Nessel, Neal Katyal
PDF
