Jeff Silvis's Blog

Some issues with bad characters

http://128.101.146.59:8080/solr/select/?version=1.2&start=0&rows=10&indent=on&wt=standard&q=fullText:food&sort=modstitle desc&qt=mods

Should be:

http://128.101.146.59:8080/solr/select/?version=1.2&start=0&rows=10&indent=on&wt=standard&q=fullText:food++%26sort%3Dmodstitle%2Bdesc&qt=mods

Fields that Solr searches on should be single valued
Bill found out that fields that are being used for sort must be single values.  Our title field is not.  In the past SOLR would handle multivalued fields for sort.

The MODS schema

	<titleInfo>
 	 	<title>[dc.title]</title>
 	</titleInfo>
<titleInfo type="translated">
 	 	<title>[dc.title.alternative]</title>
 	</titleInfo>


The XSLT to make SOLR indices
Note the XSLT will not distinguish between different values of the type attribute, so there is more than version of title, it will no longer be single valued.

/Users/birage/fedora/tomcat/webapps/fedoragsearch/WEB-INF/classes/config/index/GSearch_solr/demoFoxmlToSolr.xslt  

    <xsl:for-each select="foxml:datastream[@ID='MODS']/foxml:datastreamVersion[last()]/foxml:xmlContent//mods:titleInfo/mods:title">
         <xsl:if test="text() [normalize-space(.) ]"><!--don't bother with empty space-->
            <field>./WEB-INF/classes/config/index/GSearch_solr/demoFoxmlToSolr.xslt
               <xsl:attribute name="name">
                  <xsl:value-of select="concat('mods.', 'title')"/>
               </xsl:attribute>
               <xsl:value-of select="text()"/>
            </field>
         </xsl:if>
      </xsl:for-each>


Possible values for the type attribute of title element in MODS

From:  
http://www.loc.gov/standards/mods/v3/mods-userguide-elements.html  


		type - This attribute is applied when it is necessary to identify what type of title is recorded. 

        For the main title (MARC 21 field 245), no type is indicated. The following values may be used with the type attribute:

		abbreviated (equivalent to MARC 21 field 210)

		translated (equivalent to MARC 21 field 242, 246)

		alternative (equivalent to MARC 21 fields 246, 740)

		uniform (equivalent to MARC 21 fields 130, 240, 730)

                              
                              

                                 Posted by Jeffrey Silvis at  4:56 PM | Permalink
                                 | Comments (0)
                                 
                              
                           

The bug

Unable to connect to Solr server 

Islandora code connected to the problem

/**
 *
 * @param String $solr_url
 * @return boolean
 *
 * Checks availability of Solr installation
 *
 */
function solr_available($solr_url) {
  // path from url is parsed to allow graceful inclusion or exclusion of 'http://'
  $pathParts = parse_url($solr_url); 
  $path = 'http://' . $pathParts['host'] . ':' . $pathParts['port'] . $pathParts['path'] . '/admin/file';
  $test = @fopen($path, "r");
  if ($test) {
    return true;
  }
  return false;
}
    

The fix (upgrade SOLR)

"/admin/file"

Posted by Jeffrey Silvis at 12:03 PM | Permalink | Comments (0)

Posted by Jeffrey Silvis at 5:16 PM | Permalink | Comments (0)

Crontab

media_launch.sh

filter-media.sh

Posted by Jeffrey Silvis at 4:47 PM | Permalink | Comments (0)

Problem

The cause

dspace_sr=> select * from handle where handle = 113790;
 handle_id | handle | resource_type_id | resource_id 
-----------+--------+------------------+-------------
     51427 | 113790 |                2 |       53352


dspace_sr=> select * from item where item_id = 53352;

 item_id | submitter_id | in_archive | withdrawn |       last_modified        | owning_collection 
---------+--------------+------------+-----------+----------------------------+-------------------
   53352 |         2680 | f          | f         | 2011-08-25 12:58:34.912-05 |                  
(1 row)

The solution

UPDATE item SET withdrawn = 'T' WHERE item_id = 53352;

Posted by Jeffrey Silvis at 11:17 AM | Permalink | Comments (0)

List of datastreams in a Fedora Object

curl example

browser example

MODs Datastream

curl example

browser example

RDF Datastream

curl example

browser example

Get all triples

curl example

browser example

All triples with 36284 handle as a predicate

curl example

browser example

All triples with 36284 handle as a subject

curl example

browser example

Determine if 36284 is a collection

curl example

Find the title of 36284

Posted by Jeffrey Silvis at 4:40 PM | Permalink | Comments (1)