UM-specific BibClass Data Processing

From DLXS Documentation

(Difference between revisions)
Jump to: navigation, search
Line 2: Line 2:
<hr>   
<hr>   
-
   - before anything, ask to have new bib coll authorized: public access and hosted on hti
+
   - before anything, ask to have new bib coll authorized: public access and hosted on quod
   - also have stats entry created for new bib coll
   - also have stats entry created for new bib coll
-
   - the xml file should be in /l1/prep/d/dlpscoll/dlpstext/new/ or /l1/prep/d/dlpscoll/dlpsimage/new  
+
   - the xml file should be in <code>/l1/prep/d/dlpscoll/dlpstext/new/</code> or <code>/l1/prep/d/dlpscoll/dlpsimage/new</code> or <code>/l1/prep/d/dlpscoll/spotext/new</code>
-
  or /l1/prep/d/dlpscoll/spotext/new
+
   - move xml file to <code>/l1/obj/d/dlpscoll</code>
-
   - move xml file to /l1/obj/d/dlpscoll
+
   - on sangria, index the xml file
   - on sangria, index the xml file
-
   cd /l1/idx/d/dlpscoll
+
   <code>cd /l1/idx/d/dlpscoll</code>
   - cp the bib-sample.dd
   - cp the bib-sample.dd
-
   cp bib-sample.dd busadwp-bib.dd
+
   <code>cp bib-sample.dd busadwp-bib.dd</code>
-
   - edit busadwp-bib.dd so that /l1/obj/b/bib-sample/bib-sample becomes /l1/obj/d/dlpscoll/busadwp-bib  
+
   - edit busadwp-bib.dd so that <code>/l1/obj/b/bib-sample/bib-sample</code> becomes <code>/l1/obj/d/dlpscoll/busadwp-bib</code> in the three places it's needed
-
  in the three places it's needed
+
   - create the init file for this coll
   - create the init file for this coll
-
   cp bib-sample.init busadwp-bib.init
+
   <code>cp bib-sample.init busadwp-bib.init</code>
   - find out how big your obj file is
   - find out how big your obj file is
-
   ls -la /l1/obj/d/dlpscoll/busadwp-bib.xml
+
   <code>ls -la /l1/obj/d/dlpscoll/busadwp-bib.xml</code>
   - index the file
   - index the file
-
   xpatbldu -m [x]m -D busadwp-bib.dd  
+
   <code>xpatbldu -m [x]m -D busadwp-bib.dd</code>
-
   - where [x] = up to two times the size of the busadwp-bib.xml file, but no more than 75% of the  
+
   - where [x] = up to two times the size of the busadwp-bib.xml file, but no more than 75% of the RAM on the server
-
  RAM on the server
+
   <code>multirgn -f -D busadwp-bib.dd -t bib-regions.tags</code>
-
   - multirgn -f -D busadwp-bib.dd -t bib-regions.tags
+
   - add a record in collmgr
   - add a record in collmgr
   collectionid = busadwp-bib
   collectionid = busadwp-bib
Line 29: Line 26:
   extendedname = University of Michigan Business Administration Working Papers
   extendedname = University of Michigan Business Administration Working Papers
   hold = no
   hold = no
-
   homesite = http://www.hti.umich.edu
+
   homesite = http://quod.lib.umich.edu
-
   host = www.hti.umich.edu
+
   host = quod.lib.umich.edu
   locale = en_US.UTF-8
   locale = en_US.UTF-8
   map = bib.map
   map = bib.map
Line 48: Line 45:
   regionsearch = entire record [and] author [and] title
   regionsearch = entire record [and] author [and] title
   - move your index from sangria to clamato and dlps10, and thus production
   - move your index from sangria to clamato and dlps10, and thus production
-
   cd /l1/bin/b/bib
+
   <code>cd /l1/bin/b/bib</code>
-
   rdist -f rdist.dlpscoll -m clamato.umdl.umich.edu
+
   <code>rdist -f rdist.dlpscoll</code>
-
  rdist -s hti -f rdist.dlpscoll
+
   - authorize yourself to look at the collection, before it is officially authorized
   - authorize yourself to look at the collection, before it is officially authorized
-
   cd /l1/dev/[uniqname]/cgi/b/bib
+
   <code>cd /l1/dev/[uniqname]/cgi/b/bib</code>
   - add busadwp-bib to AUTHZD_COLL
   - add busadwp-bib to AUTHZD_COLL
   - create an HTML index page for your collection.
   - create an HTML index page for your collection.
-
   cd /l1/dev/[uniqname]/web/d/dlpscoll
+
   <code>cd /l1/dev/[uniqname]/web/d/dlpscoll</code>
-
   mkdir busadwp-bib
+
   <code>mkdir busadwp-bib</code>
-
   cvs add busadwp-bib
+
   <code>cvs add busadwp-bib</code>
-
   cp sample_index.tpl busadwp-bib
+
   <code>cp sample_index.tpl busadwp-bib</code>
-
   cd busadwp-bib
+
   <code>cd busadwp-bib</code>
-
   mv sample_index.tpl index.tpl
+
   <code>mv sample_index.tpl index.tpl</code>
   - open the index.tpl file and change the title and h2 tags to reflect the full name  
   - open the index.tpl file and change the title and h2 tags to reflect the full name  
   of the collection, and add the description from colldescr
   of the collection, and add the description from colldescr
-
   - cvs add index.tpl
+
   <code>cvs add index.tpl</code>
-
   - cvs commit index.tpl
+
   <code>cvs commit index.tpl</code>
   - update the release script to incorporate these for release.
   - update the release script to incorporate these for release.
-
   cd /l1/dev/[uniqname]/bin/b/bib
+
   <code>cd /l1/dev/[uniqname]/bin/b/bib</code>
   - add '/web/d/dlpscoll/busadwp-bib' => '-R', # recurse to cvstag.bib
   - add '/web/d/dlpscoll/busadwp-bib' => '-R', # recurse to cvstag.bib
-
   cvs commit cvstag.bib
+
   <code>cvs commit cvstag.bib</code>
   - find the range of dates in the collection
   - find the range of dates in the collection
   - go back to sangria
   - go back to sangria
-
   xpatu /l1/idx/d/dlpscoll/busadwp-bib.dd
+
   <code>xpatu /l1/idx/d/dlpscoll/busadwp-bib.dd</code>
-
   region YR
+
   <code>region YR</code>
-
   {savefile "dates"}
+
   <code>{savefile "dates"}</code>
-
   save.region.1
+
   <code>save.region.1</code>
-
   /l1/prep/d/dlpscoll/scripts/daterange.pl dates | sort | uniq | more
+
   <code>/l1/prep/d/dlpscoll/scripts/daterange.pl dates | sort | uniq | more</code>
   - go back to the record in collmgr and add:
   - go back to the record in collmgr and add:
   minmaxyearstart = [first date]
   minmaxyearstart = [first date]

Revision as of 15:45, 9 October 2007

Main Page > Mounting Collections: Class-specific Steps > Mounting a Bib Class Collection > UM-specific BibClass Data Processing


  - before anything, ask to have new bib coll authorized: public access and hosted on quod
  - also have stats entry created for new bib coll
  - the xml file should be in /l1/prep/d/dlpscoll/dlpstext/new/ or /l1/prep/d/dlpscoll/dlpsimage/new or /l1/prep/d/dlpscoll/spotext/new
  - move xml file to /l1/obj/d/dlpscoll
  - on sangria, index the xml file
  cd /l1/idx/d/dlpscoll
  - cp the bib-sample.dd
  cp bib-sample.dd busadwp-bib.dd
  - edit busadwp-bib.dd so that /l1/obj/b/bib-sample/bib-sample becomes /l1/obj/d/dlpscoll/busadwp-bib in the three places it's needed
  - create the init file for this coll
  cp bib-sample.init busadwp-bib.init
  - find out how big your obj file is
  ls -la /l1/obj/d/dlpscoll/busadwp-bib.xml
  - index the file
  xpatbldu -m [x]m -D busadwp-bib.dd
  - where [x] = up to two times the size of the busadwp-bib.xml file, but no more than 75% of the RAM on the server
  multirgn -f -D busadwp-bib.dd -t bib-regions.tags
  - add a record in collmgr
  collectionid = busadwp-bib
  collname = University of Michigan Business Administration Working Papers
  appmodule = BibApp
  browseable = no
  extendedname = University of Michigan Business Administration Working Papers
  hold = no
  homesite = http://quod.lib.umich.edu
  host = quod.lib.umich.edu
  locale = en_US.UTF-8
  map = bib.map
  objdir = /d/dlpscoll
  port = 620
  primaryhref = default
  primarytitle = text:University of Michigan Business Administration Working Papers
  querylanguage = xpat
  rendering = perl
  secondarytitle = default
  sortthreshold = 1000
  subclassmodule = BibClass
  webdir = /d/dlpscoll/busadwp-bib
  authsystems = um
  colldescr = [a description based on the original coll description]
  dd = /idx/d/dlpscoll/busadwp-bib.dd
  regionsearch = entire record [and] author [and] title
  - move your index from sangria to clamato and dlps10, and thus production
  cd /l1/bin/b/bib
  rdist -f rdist.dlpscoll
  - authorize yourself to look at the collection, before it is officially authorized
  cd /l1/dev/[uniqname]/cgi/b/bib
  - add busadwp-bib to AUTHZD_COLL
  - create an HTML index page for your collection.
  cd /l1/dev/[uniqname]/web/d/dlpscoll
  mkdir busadwp-bib
  cvs add busadwp-bib
  cp sample_index.tpl busadwp-bib
  cd busadwp-bib
  mv sample_index.tpl index.tpl
  - open the index.tpl file and change the title and h2 tags to reflect the full name 
  of the collection, and add the description from colldescr
  cvs add index.tpl
  cvs commit index.tpl
  - update the release script to incorporate these for release.
  cd /l1/dev/[uniqname]/bin/b/bib
  - add '/web/d/dlpscoll/busadwp-bib' => '-R', # recurse to cvstag.bib
  cvs commit cvstag.bib
  - find the range of dates in the collection
  - go back to sangria
  xpatu /l1/idx/d/dlpscoll/busadwp-bib.dd
  region YR
  {savefile "dates"}
  save.region.1
  /l1/prep/d/dlpscoll/scripts/daterange.pl dates | sort | uniq | more
  - go back to the record in collmgr and add:
  minmaxyearstart = [first date]
  minmaxyearend = [last date]
  - look at everything at http://[uniqname].dev.umdl.umich.edu/cgi/b/bib/bib-idx?c=busadwp-bib
  - choose the groups you want to add the collection to in collmgr
  - for OAI, choose the oaiall group

Top

Personal tools