Condor Project News > HTCondor 8.7.2 released! ( June 22, 2017 )

The HTCondor team is pleased to announce the release of HTCondor 8.7.2. This development series release contains new features that are under development. This release contains all of the bug fixes from the 8.6.4 stable release. Enhancements in the release include: Improved condor_schedd performance by turning off file checks by default; condor_annex -status finds VM instances that have not joined the pool; Able to update an annex's lease without adding new instances; condor_annex now keeps a command log; condor_q produces an expanded multi-line summary; Automatically retry and/or resume http file transfers when appropriate; Reduced load on the condor_collector by optimizing queries; A python based condor_top tool. Further details can be found in the Development Version History and the Stable Version History. HTCondor 8.7.2 binaries and source code are available from our Downloads page.

Condor Project News > HTCondor 8.6.4 released! ( June 22, 2017 )

The HTCondor team is pleased to announce the release of HTCondor 8.6.4. A stable series release contains significant bug fixes. Highlights of this release are: Python bindings are now available on MacOSX; Fixed a bug where PASSWORD authentication could fail to exchange keys; Pslot preemption now properly handles custom resources, such as GPUs; condor_submit now checks X.509 proxy expiration. More details about the fixes can be found in the Version History. HTCondor 8.6.4 binaries and source code are available from our Downloads page.

News and Announcements from OSG Operations > GOC Service Update - Tuesday, June 27th at 14:00 UTC

The GOC will upgrade the following services beginning Tuesday, June 27th at 1400 UTC. The GOC reserves 8 hours in the unlikely event unexpected problems are encountered.

GRACC
- Fixed generation of GRACC summaries for HTCondor jobs that were removed.  Reprocessed old records with this issue as well.

Oasis
- Modifications of virtual machine host to allow oasis components to access USB ports.

VOMS
- Update voms-admin to 2.7.0-1.22 per request.

All services
- Operating system updates; reboots will be required. The usual HA mechanisms will be used, but some services will experience brief outages.

News and Announcements from OSG Operations > Announcing OSG CA Certificate and VO Package Updates

We are pleased to announce a data release for the OSG Software Stack.
Data releases do not contain any software changes.

This release contains updated CA Certificates based on IGTF 1.83:
- Added new trust anchor for accredited KISTI CA v3 (KR)
- Removed obsolete GEANT TCS G1 and G2 (old Comodo-backed) trust anchors

This release also contains VO Package v74:
- Fix the edg-mkgridmap entries for project8 and miniclean
- Add new VOMS entry for CIGI
- Add LIGO entry to GUMS template
- Fix vo-client ATLAS mappings

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3402

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

News and Announcements from OSG Operations > Announcing OSG Software version 3.4.0

We are pleased to announce OSG Software version 3.4.0.

OSG 3.4.0 is the start of a new release series. In this series we have
streamlined and consolidated the set of packages. This release contains
all the updates of the recent OSG 3.3.25 release.

This release also contains:
- HTCondor 8.6.3 - see release notes for upgrade information
- Frontier-squid 3.5.24-3.1 - see release notes for upgrade information
- GlideinWMS 3.3.2 in the Upcoming repository

Temporarily unavailable in OSG 3.4:
- HDFS - 3.x to be included in OSG 3.4 at a later date

No longer available in OSG 3.4:
- edg-mkgridmap - replaced by LCMAPS VOMS plugin
- GUMS - replaced by LCMAPS VOMS plugin
- BeSTMan 2 - replaced by Load Balanced GridFTP
- GLExec - replaced by Singularity
- VOMS Admin Server - being retired
- Globus GRAM - available from EPEL
- GIP and OSG Info Services - BDII servers retired

In addition to the list of packages in OSG 3.4, the release notes also
contain a comprehensive list of packages not carried forward from OSG 3.3.

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release340

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

News and Announcements from OSG Operations > Announcing OSG Software version 3.3.25


We are pleased to announce OSG Software version 3.3.25.

Changes to OSG 3.3.25 include:
- lcmaps VOMS plugin mapping uses the first FQAN to behave similar to GUMS
- Update to XRootD 4.6.1
- Update to GlideinWMS 3.2.19
- HTCondor-CE: Add ability to request whole node jobs from the batch system
- Install default VO mapfile with osg-ce/osg-gridftp for lcmaps VOMS plugin
- voms-admin-server security update
- Fix osg-update-vos script to pick up new vo-client changes
- osg-configure can get the default allowed_vos from the lcmaps VOMS plugin
- osg-configure can use lcmaps VOMS plugin to get the default allowed VOs
- osg-ca-scripts now refers to repo.grid.iu.edu

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3325

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

Derek's Blog > StashCache

StashCache is a framework to distribute data across the Open Science Grid. It is designed to help opportunistic users to transfer data without the need for dedicated storage or frameworks of their own, like CMS and ATLAS have deployed. StashCache has several regional caches and a small set of origin servers. Caches have fast network connections, and sizable disk storage to quickly distribute data to the execution hosts in the OSG.

StashCache is named for the Stash filesystem located at the University of Chicago’s OSG-Connect service. It is primarily intended to be used to cache data from the Stash filesystem, though, data origins exist for other experiments.

Regional Caches Regional Caches

Components

The worker nodes are where the user jobs will run. The transfer tools are used on the worker nodes to download data from StashCache caches. Worker nodes are geographically distributed across the US, and will select the nearest cache based upon a GeoIP database.

StashCache Architecture StashCache Architecture

The caches are distributed to computing sites across the U.S. They are are running the XRootD software. The worker nodes connect directly to the regional caches, which in turn download from the Origin servers. The caching proxies discover the data origin by querying the Redirectors. The caching algorithm used is Least Recently Used (LRU). In this algorithm, the cache will only delete cached data when storage space is near capacity, and will delete the least recently used data first.

The origin servers are the primary source of data for the StashCache framework. StashCache was named after the Stash data store at the University of Chicago’s OSG-Connect service, but other origins also utilize the framework. The origin is the initial source of data, but once the data is stored on the Caches, the origin is no longer used. Updates to data on the origin are not reflected in the caches automatically. The caches treat the data from the origin as immutable, and therefore do not check for updates. If a user requires new data to be pulled into the cache, the name or location of the data on the origin must be changed.

Redirectors are used to discover the location of data. They are run only at the Indiana Grid Operations Center (GOC). The redirectors help in the discovery of the origin for data. Only the caching proxies communicate with the redirectors.

Tools to transfer

Two tools exist to download data from StashCache, CVMFS and StashCP. With either of these tools, the first step for users is to copy the data to the Stash filesystem. Once the user has an OSG-Connect account, they may copy their data to the /stash//public directory. Once there, both of the tools can view and download the files.

CVMFS (CERN Virtual Machine File System) is a mountable filesystem that appears to the user as a regular directory. CVMFS provides transparent access for users to data in the Stash filesystem. The namespace, such as the size and name of files, and the data are separate in the Stash CVMFS. CVMFS distributes the namespace information for the Stash filesystem over a series of HTTP Forward Proxies that are separate from the StashCache federation. Data is retrieved through the Stash proxies.

In order to map the Stash filesystem into CVMFS, a process is constantly scanning the Stash filesystem checking for new files. When new files are discovered, they are checksummed and the meta-data is stored in the CVMFS namespace. Since this scanning can take a while for a filesystem the size of Stash, it may take several hours for a file placed in Stash to be available through CVMFS.

Using CVMFS, copying files is as easy as copying files with any other filesystem:

$ cp /cvmfs/stash.osgstorage.org/user/<username>/public/… dest/

CVMFS access also has other features that are beneficial for Stash access. CVMFS will cache files locally so that multiple accesses to the same file on the same node will be very fast. Also, CVMFS can fallback to other nearby caches if the first fails.

StashCP is the second tool that can download data from StashCache. StashCP uses CVMFS above, as well as falling back to the caching proxies and eventually the origin. The order of operations that StashCP performs:

  1. Check for the file in CVMFS mount under /cvmfs/stash.osgstorage.org/…
  2. If CVMFS copy fails, connect directly to the nearest proxy and attempt to download the file.
  3. If the proxy fails, then connect directly to the origin server.

Since StashCP doesn’t rely on the CVMFS mount only, files are immediately available to transfer with StashCP.

StashCP is distributed with OSG-Connect’s module system. Using StashCP is nearly as simple as using the cp command:

$ module load  stashcp
$ stashcp /user/<username>/public/… dest/

Conclusions

The StashCache framework is very useful for downloading data to execution hosts across the OSG. It was designed to help opportunistic users to transfer data without the need for dedicated storage or frameworks of their own, like CMS and ATLAS have deployed.

StashCache has been used to transfer over 3 PB of data this year. Check out some of the papers written about using StashCache:

  • Derek Weitzel, Brian Bockelman, Duncan A. Brown, Peter Couvares, and Frank Wu ̈rthwein, Edgar Fajardo Hernandez. 2017. Data Access for LIGO on the OSG. In Proceedings of PEARC17, New Orleans, LA, USA, July 09-13, 2017, 6 pages. DOI: 10.1145/3093338.3093363 Online
  • Derek Weitzel, Brian Bockelman, Dave Dykstra, Jakob Blomer, and René Meusel, 2017. Accessing Data Federations with CVMFS. In Journal of Physics - Conference Series. Online

News and Announcements from OSG Operations > GOC Service Update - Tuesday, June 13th at 14:00 UTC

The GOC will upgrade the following services beginning Tuesday, June 13th at 14:00 UTC.  The GOC reserves 8 hours in the unlikely event unexpected problems are encountered.

Display
- Configuration management changes conclude

Jira
- Upgrade RAM to 4GiB, required by recent upgrade to 7.3

MyOSG
- VO SUMMARY output messages cleaned up to minimize root mail

News and Announcements from OSG Operations > Open Science Grid to host two training sessions at PEARC17 - Monday, July 10, 2017

Colleagues,

Open Science Grid (OSG) is hosting two training sessions on Monday, July 10, 2017 at the PEARC17 Conference and we would like to encourage you to attend.  Our training sessions will use OSG Connect (http://osgconnect.net/) to show you how OSG can be leveraged to help you improve your research computing workflows.  

The training sessions are as follows:

High-Throughput Computation on the Open Science Grid and AWS - 9:00am - 12:30pm
  * Detailed information: https://pearc17.sched.com/event/AQ3M

Enabling Science Beyond the Campus Edge: HPC Integration with the Open Science Grid - 1:30pm - 5:00pm
  * Detailed information: https://pearc17.sched.com/event/AQ3V

Please sign up to attend or pass this information along to any colleagues you know that might benefit from these two opportunities!  

Condor Project News > Register soon for the European HTCondor workshop! ( May 22, 2017 )

The 2017 European HTCondor workshop will be held at DESY in Hamburg from Tuesday 6 June through Friday 9 June. This is a chance to find out more about HTCondor from the developers, and also to provide feedback and learn from other HTCondor users. Participation is open to all organizations and persons interested in HTCondor. The registration deadline is Tuesday 30 May -- register here (this web site also has much more information about the conference). If you're planning to attend, please consider speaking -- we'd like to hear about your project and how you are using HTCondor. Abstracts will be accepted through Friday 26 May via the conference page linked above; follow the "Call for Abstracts" link and select "Submit new abstract".

News and Announcements from OSG Operations > PEARC17 early registration and hotel booking deadline - May 31

May 31 is the deadline for Practice and Experience in Advanced Research Computing (PEARC17) attendees to take advantage of early registration and guaranteed hotel room rates.

Go to http://pearc17.pearc.org to register for the conference and check the latest program schedule. To book rooms, go to http://pearc17.pearc.org hotel or call 888-421-1442 and reference the conference name.

PEARC17 attendees staying at the Hyatt Regency New Orleans will experience the best of the Big Easy. The hotel is located in the heart of downtown, next to the Mercedes-Benz Superdome, Smoothie King Center and Champions Square. Nearby attractions include taking a ride on the Loyola Avenue Streetcar, which passes directly in front of the hotel, or a walk to the historic French Quarter, Arts District, Audubon Aquarium of the Americas, the National World War II Museum, and the scenic Mississippi Riverfront—all located within a mile of the hotel. Attendees will also savor some of the city’s best cuisine at the hotel's restaurants and dining options: 8 Block Kitchen & Bar, Vitascope Hall, Q Smokery & Cafe, Pizza Consegna and Borgne by celebrity Chef John Besh.

To help plan your visit to the Big Easy, the PEARC17 web site has information about things to do and see in and around New Orleans, as well as additional informative links. See http://pearc17.pearc.org/new-orleans.

News and Announcements from OSG Operations > GOC Service Update - Tuesday, May 23rd at 14:00 UTC

The GOC will upgrade the following services beginning Tuesday, May 23rd at 14:00 UTC. The GOC reserves 8 hours in the unlikely event unexpected problems are encountered.
Repo
  * Defining new content locations in preparation for OSG 3.4


Ticket
  * Submit form update


MyOSG
  * Redirect to new meshconfig setup


Display
  * Update scripts to remove extraneous error messages


All services
  * Operating system updates; reboots will be required. The usual HA mechanisms will be used, but some services will experience brief outages.


News and Announcements from OSG Operations > Announcing VO Package Update

We are pleased to announce a data release for the OSG Software Stack.
Data releases do not contain any software changes.

This release contains VO Package v73:
- Update edg-mkgridmap CDF entry to match vomses
- Remove LIGO server from GUMS template
- Remove unused CDF glidecaf settings
- Drop /production role for DES vomsUserGroup
- Update default CMS mappings
- Update default Fermilab / FIFE mappings

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release33242

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

News and Announcements from OSG Operations > Announcing OSG Software version 3.3.24

We are pleased to announce OSG Software version 3.3.24.

Changes to OSG 3.3.24 include:
- osg-configure 1.7.0: support lcmaps VOMS plugin, drop BDII configuration
- CVMFS X.509 helper: fix for running inside a container
- Added gsissh to tarball installations

Changes to the Upcoming Repository include:
- HTCondor 8.6.2: Bug fixes
- GlideinWMS 3.3.2: BOSCO multiple remote directories, AWS VM improvements

Release notes and pointers to more documentation can be found at:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/Release3324

Need help? Let us know:

https://www.opensciencegrid.org/bin/view/Documentation/Release3/HelpProcedure

We welcome feedback on this release!

Condor Project News > HTCondor 8.6.3 released! ( May 9, 2017 )

The HTCondor team is pleased to announce the release of HTCondor 8.6.3. A stable series release contains significant bug fixes. Highlights of this release are: Fixed a bug where using an X.509 proxy might corrupt the job queue log; Fixed a memory leak in the Python bindings. More details about the fixes can be found in the Version History. HTCondor 8.6.3 binaries and source code are available from our Downloads page.


Subscribe