Skip to content

CVMFS

OSG Origins data use

We host a number of OSG origins in the cluster, that can be used to distribute read-only data, f.e. software packages or datasets. You can contact us to place data on origins.

The data is stored in a single server spinning drives JBOD, with RAID 50.

Credit: Origins space

Caches and origins map

Using OSG caches and origins data via CVMFS

To attach the CVMFS volume which can mount all repos, create the PVC (taken from https://github.com/cvmfs-contrib/cvmfs-csi/tree/master/example ):

apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: cvmfs
spec:
  accessModes:
  - ReadOnlyMany
  resources:
    requests:
      # Volume size value has no effect and is ignored
      # by the driver, but must be non-zero.
      storage: 1
  storageClassName: cvmfs

Then attach it to your pod:

apiVersion: v1
kind: Pod
metadata:
  name: cvmfs-all-repos
spec:
  containers:
   - name: idle
     image: busybox
     imagePullPolicy: IfNotPresent
     command: [ "/bin/sh", "-c", "trap : TERM INT; (while true; do sleep 1000; done) & wait" ]
     volumeMounts:
       - name: my-cvmfs
         mountPath: /my-cvmfs
         # CVMFS automount volumes must be mounted with HostToContainer mount propagation.
         mountPropagation: HostToContainer
  volumes:
   - name: my-cvmfs
     persistentVolumeClaim:
       claimName: cvmfs

If you need to mount a specific repo, add the subPath to the pod mount:

     volumeMounts:
       - name: my-cvmfs
         # It is possible to mount a single CVMFS repository by specifying subPath.
         subPath: alice.cern.ch
         mountPath: /my-alice-cvmfs
         mountPropagation: HostToContainer
Existing subPaths
  • ams.cern.ch
  • atlas.cern.ch
  • belle.cern.ch
  • clicdp.cern.ch
  • cms.cern.ch
  • config-osg.opensciencegrid.org
  • connect.opensciencegrid.org
  • cvmfs-config.cern.ch
  • eic.opensciencegrid.org
  • gluex.osgstorage.org
  • gwosc.osgstorage.org
  • icecube.opensciencegrid.org
  • icecube.osgstorage.org
  • larsoft-ib.opensciencegrid.org
  • larsoft.opensciencegrid.org
  • nexo.opensciencegrid.org
  • oasis.opensciencegrid.org
  • sdsc-nrp-osdf-origin.osgstorage.org
  • sft.cern.ch
  • singularity.opensciencegrid.org
  • snoplus.egi.eu
  • sphenix.opensciencegrid.org
  • spt.opensciencegrid.org
  • stash.osgstorage.org
  • unpacked.cern.ch
  • veritas.opensciencegrid.org