January 16, 2009 Meeting in IRRI for the setup of ICIS Web in CIMMYT and UQ servers

From ICISWiki

Jump to: navigation, search

January 16, 2009 meeting

Present: Jay,Weng,Jeff,Ching,Mylah

Agenda:

  • To clarify issues related to setting up ICIS databases for the ICIS "Core" and ICIS Cropfinder Web Applications
    • these are separate applications.
    • both are GCP Koios Web Applications


Minutes:

Deployment of ICIS Web

  • Jay went through the deployment instructions for ICIS Web (posted on the GCP Pantheon site) - including the set up of ICIS databases.
  • Weng will update the ICIS Website on UQ servers and will refer to the same deployment instructions document.
  • For the set up of the data layer(i.e. ICIS databases), the details are not in the said documentation
    • consider the setup of public and central/local databases


Procedure for setting up of databases for ICIS Web and Cropfinder Web Application

  • Involves several steps (not just taking a mysqldump and doing a restore on target server)
  • First step: involves taking a mysqldump of a database that uses the standard ICIS schema
    • How do we check that the db uses standard ICIS schema? A tool developed by Ching is available. This tool is also able to apply patch if a problem is found.
  • Second step: Once data has been loaded, manually call a stored procedure to create the data warehouse tables needed by the ICIS Web datasources for the "get all dataset per study" use case
  • Third step: Create the datawarehouse tables that the ICIS datasources need for the cropfinder application


Creating datawarehouse tables for the "get all dataset per study" use case

  • calling stored procedure stops on certain studies, generates errors (unsuccessful for some studies)
  • get_all_dataset.sql 
    --AND f.studyid < 637 and e.represno >1554

    stops on studies with large datasets
  • Weng: this is due to a mysql bug, but fixed on later versions
    • bug encountered on mysql installations on production server: mysql ver 5.0.32
    • try on mysql versions where this bug was fixed:
      • 5.0.52
      • 5.1.23
      • 6.0.4
    • Jay to install latest mysql (look for a server)
      • test on a dataset, the problematic dataset
      • Jeff to validate datasource on the mysql version


can an ICISWeb-ready database be released? (an "ICIS-Web-ready database" where all datawarehouse tables are included)

  • may not be advisable
  • how to update this db with new studies?
  • there is NO same set of data for a crop? Central + local combination
    • this is where some discussion on data flow came in. Illustrations, ERD for GMS -- were asked to be made available.
Retrieved from "http://www.cropinfo.org/icis/index.php/January_16,_2009_Meeting_in_IRRI_for_the_setup_of_ICIS_Web_in_CIMMYT_and_UQ_servers"
Personal tools