Release Notes for Current DLXS Release

From DLXS Documentation

(Difference between revisions)
Jump to: navigation, search
m (→METS Pageturner and Collection Builder)
(→CGI/Middleware)
Line 84: Line 84:
<ul>
<ul>
-
<li>Metadata fields containing xml must be mapped to ic_xml in the field_admin_maps Collection Manager field. AND, there is a bug in the released version of the data2db.pm perl module that causes fields containing XML to be skipped completely. <a href="/products/archive-by-CDROM/13/Patches">Download</a> the data2db.pm patch file.</li>
 
-
<li>July 11, 2007. data2db.pm parser for FMP DSO XML failed to handle fields where the name of the field contains special regular expression characters that needed to be quoted. <a href="/products/archive-by-CDROM/13/Patches">Download</a> the data2db.pm patch file.</li>
 
-
<li>TEXT::CSV_XS Perl module must be installed (available in CPAN) in order for the image class data loading script to perform.</li>
 
-
<li>The owner of a session based/temporary portfolio is not allowed to open it. For example, a non-authenticated user adds an image to a new portfolio and the user is not allowed to see the portfolio when it tries to open to display the new addition. To fix the problem, change the following lines of the <strong>GetBookBag</strong> method in <strong>$DLXSROOT/cgi/i/image/ImageApp.pm</strong>.
 
-
<br><strong>Old</strong>
 
-
<pre>
 
-
  if ( ( lc($ENV{'REMOTE_USER'}) ne lc($portfolioOwner) ) && ( ! $portfolioPublic ) )
 
-
  {
 
-
  &DlpsUtils::errorBail( qq{Requested portfolio is not public. The owner may choose to make it so.} );
 
-
  }
 
-
</pre>
 
-
<strong>New</strong>
 
-
<pre>
 
-
  my $sessionid = &DlpsUtils::GetReadOnlySessionId();
 
-
  my $username = $ENV{'REMOTE_USER'} || qq{sid-} . $sessionid;
 
-
 
-
  if ( ( $username !~ m/^$portfolioOwner$/i ) && ( ! $portfolioPublic ) )
 
-
  {
 
-
  &DlpsUtils::errorBail( qq{Requested portfolio is not public. The owner may choose to make it so.} );
 
-
  }
 
-
</pre>
 
-
 
-
      </li>
 
     </ul>
     </ul>
Line 114: Line 91:
<b><p>Speed/Performance Enhancements </p></b>
<b><p>Speed/Performance Enhancements </p></b>
   <ul>
   <ul>
-
   <li>Sliced viewing of portfolios was added to improve performance of large portfolios
+
    
-
  and to avoid getting throttled by the web server due to many thumbnail requests
+
-
  at once. This changed required some rearrangement of interface functions.</li>
+
-
  <li>Browse results are now sliced for better performance and a list of field
+
-
    values with occurrence counts is presented in the sidebar for further navigation
+
-
    within the browse results. </li>
+
-
 
+
-
  <li>Changed Image Class searching to use UNION of sql select statements rather
+
-
    than a temp table. The temp table was contributing to MySQL database replication
+
-
    errors.</li>
+
-
  <li>Thumbnails are now embedded in XHTML as a data:URI, reducing the number
+
-
    of HTTP requests and improving performance. This does not work with IE, so,
+
-
    the common thumbnail linking method is used for IE. </li>
+
-
  <li>A limited number of search results are now cached on the session in raw
+
-
    unformatted form and as XML. Look-ahead cacheing is done as the end of the
+
-
    CGI run for the next slice as well. The cacheing improves overall performance.</li>
+
   </ul>
   </ul>
<p>Other</p>
<p>Other</p>
<ul>
<ul>
-
  <li>Made changes to <em>related views</em> to support
+
-
    direct media links.</li>
+
  </ul>
-
  <li>Minor xsl change related to entry display
 
-
    of real media and pdf links.</li>
 
-
  <li>Separated thumbnail XSL code out into new template
 
-
    for easy override.</li>
 
-
  <li>Made changes to avoid searching all
 
-
    collections when no collections are selected in group search mode. It is now
 
-
      necessary for the user to select at least one collection.</li>
 
-
  <li>Improved handling
 
-
        of missing portfolio items.</li>
 
-
  <li>CSS is used to change the background color of items just added to a
 
-
          portfolio.</li>
 
-
  <li>Enlarged the display size of the DIV that encloses each thumbnail
 
-
            in the results view. This reduces the clipping of metadata in some
 
-
          cases.</li>
 
-
 
-
  <li>Image Class was modified to use a database table (ImageClassMediaFiles)
 
-
          to store and retrieve technical metadata about images instead of storing
 
-
        this information in text files on disk.</li>
 
-
  <li>Previously a record with multiple media items, each with a distinct
 
-
          caption, resulted in a single combined caption. Now captions are independently
 
-
          associated with images. Please see documentation for details of how to
 
-
          take advantage of this new functionality relating to <em>ic_vi </em>field
 
-
        mappings. </li>
 
-
  <li>Added ability to output xml (rather than xhtml or html, and without
 
-
          using debug=XML) after applying xslt to original xml.</li>
 
-
  <li>Improved retrieval of items when an exact match of the ID is not possible.
 
-
          For example, when an id stored in a portfolio fails to work as is, there
 
-
          are some simple things that can be done to find the right record in most
 
-
          cases.</li>
 
-
  <li>Fixed a bug that allowed private portfolios to be retrieved by ID,
 
-
          even if not the owner. This situation was not likely to occur in real
 
-
          use, and it did not make the content accessible, just the structure of
 
-
          the portfolio.</li>
 
-
 
-
  <li>Browse level configuration can now be done per field using Collmgr. </li>
 
-
  <li>Image Class items can now be retrieved by filename alone if there is
 
-
          an exact match with an entry. </li>
 
-
  <li>Changed handling of captions in related views for situation where there
 
-
          is no image for the view to display the caption. This is helpful with
 
-
          a database that has a single record with &quot;views&quot; for digital
 
-
          and slide so that the slide has reasonable representation in the related
 
-
          views table.</li>
 
-
  <li>Added a status check on prep tables to make sure there are indexes before
 
-
          allowing the middleware to hit on them. This adds stability in certain
 
-
          environments, like Michigan's where MySQL replication is in use.</li>
 
-
  <li>Improved handling of AUTHZD_COLL list for comparision to entry auth
 
-
          value for allowing/denying access to full image.</li>
 
-
 
-
  <li>Enhanced getimage-idx to do a better job of finding an image where
 
-
          the viewid has changed for some reason, and a stale external link is
 
-
          being used.</li>
 
-
  </ul>
 
====Data Preparation====
====Data Preparation====
<p>Speed/Performance Enhancements </p>
<p>Speed/Performance Enhancements </p>

Revision as of 15:29, 12 August 2008

Main Page > Release Notes for Current DLXS Release

Contents

General Information

TextClass is substantially identical to release 13 except for bug fixes as noted below. ImageClass provides new image viewing functionality. FindaidClass improves handling of the EAD DTD and includes subject browsing. BibClass is unchanged and is being de-emphasized.

Release 14 is comprised of:

Known Problems

  • None

Database Installation Notes

MySQL is the supported database type. In order to run DLXS you will need to have a MySQL server installed. Sample data is delivered in the form of a MySQL dump file which can be directly imported into a MySQL database. The database upgrade script (upgrade_6_7) operates only on a MySQL database. These issues are documented in detail in the installation instructions and the upgrade instructions.

New and Changed Functionality

XPAT

  • No changes.

Lib

TextClass

XML template and XSL stylesheet changes

CGI/Middleware

ImageClass

CGI/Middleware

Known Problems


Speed/Performance Enhancements

Other

Data Preparation

Speed/Performance Enhancements

  • Image Class was modified to use a database table (ImageClassMediaFiles) to store and retrieve technical metadata about images instead of storing this information in text files on disk. Unofficially, metadata loading is 2-4 times faster than it was before because image filenaming checking is faster with the table.
  • Tables are now locked during metadata loading. This speeds up the data loading.
  • Consolidated table optimizations into single MySQL statement rather than several. The same was done for index building. This is approach is much faster.
  • Combined ic_all (all fields of the record) field is now made into a unique list of words to reduce the size of ic_all a little, and in turn improve search performance.

Other
  • Made changes to the key Image Class data loading scripts to add an option that allows data records to be loaded to an alternative (e.g., development or prep) MySQL server. The option is configured globally in the icdbprep.cfg file, and can also be controlled with a command line parameter for load.pl, icdbprep.pl, fmpxml2mysql.pl (deprecated in favor of data2db.pl), and data2db.pl.
  • The mediaprep script replaced imageprep as the utility for gathering information about media files for use with Image Class. mediaprep works with the new ImageClassMediaFiles table.
  • Previously a record with multiple media items, each with a distinct caption, resulted in a single combined caption. Now captions are independently associated with images. Please see documentation for details of how to take advantage of this new functionality relating to ic_vi field mappings.
  • Changed the way the ic_all field is assembled so that it includes "istruct_caption_" fields that are mapped to ic_all.
  • Session timeouts during data loading are now avoided by making the sessions empty so that there is no attempt to write the session back to the session database.
  • If a ic_id was > 255, index would not get added. Now, it will, for those odd situations where an ic_id is so long (probably a data error).
  • Case of filename field names was not handled properly. Uppercase fieldnames were ignored. This had been fixed.
  • Changed "splitrepeatingfield" routine so that it no longer splits on a comma in an ic_vi (caption) or ic_fn (filename) field. ic_vi fields often include commas not meant as delimiters.
  • Added automatic database reconnection. This is most likely to aid data loading processes in certain environments. This is actually a change to DbUtils.pm, but is most beneficial to Image Class.
  • Removed a filter for binary files that was getting confused about text PDFs and RAM files that simply enclose a URL for redirection.

BibClass

Oai

broker20

  • No changes.


Collmgr

  • Supports version 7.0 database for DLXS release14.

FindaidClass

XML template and XSL stylesheet changes

CGI/Middleware

XClass

  • No changes.

METS Pageturner and Collection Builder

  • Continuing development work in Pageturner. New application: Collection Builder allowing users to add items to a personal collection via widgets in Pageturner. These applications are not part of DLXS. They use a different code base mainly under DLXSROOT/{web,bin,cgi}/m/mdp and DLXSROOT/lib/App. Stub routines are required in Pageturner to abstract the database connections and an installation of Solr/Lucene is required to support the collection search in Collection Builder. The user interface makes extensive use of Yahoo User Interface (YUI) functionality.

Top

Retrieved from "http://webservices.itcs.umich.edu/mediawiki/dlxs14/index.php/Release_Notes_for_Current_DLXS_Release"
Personal tools