View source for March 2010 Hackathon

Before the NBIC Conference on 29/30 March, we have organized a '''Hackathon''' on Friday 26 and Saturday 27 March. Results of the hackathon have been presented on the second day of the conference in a lunch session. This presentation has been filmed.

= Pictures of the work during the hackathon =

Pictures are available on [http://rwwh.smugmug.com/Other/Hackathon-2010 Rob Hooft's photo site]

= Projects for the Hack-a-thon =

== Expose ConceptWiki to semantic web and show interconnection with other sources ==

=== Needs for task ===

# Content negotiation for a *simple* RDF based resolution of ConceptWiki to provide results in RDF format
# new UI to view the concept information based on the RDF pages
# mash up of conceptwiki RDF pages and bio2rdf RDF pages

=== Responsibility ===
* Scientific Lead: Andrew Gibson
* Technical support: Kees Burger

=== Plans ===
Import of CWA format into the Concept Wiki first by using only urls represented in the ConceptWiki. The cwa format should be hosted on another site. Later, we should use Bio2RDF urls and use the ConceptWiki to dereference those URLs. 

Includes the following activities:
* To be done before hackathon: Use an open source SQL2RDF tool, e.g., D2RQ, SquirrelRDF or OpenLink Virtuoso, to expose data.  
* In addition we can make a small application showing how we resolve different URI's for the same concept via the ConceptWiki and maybe 'bridgedb' software from Maastricht
* Marco is also interested in developing a workflow that creates the mapping between the RDF interface of the provider and the CWA format.
* Demo for NBIC conference: If sparql will allow us to pull very specific statements from the ConceptWiki triple store, we should show that several of the same identifiers are used to indicate different concepts (ambiguous identifiers). 

'''Action Points''':
# Get D2RQ, SquirrelRDF and OpenLink Virtuoso into local code base
# Set up a sandbox DB server contains latest ConceptWiki DB
# Get a workflow management software into local code base
# Select a few external data providers that support RDF ie bio2RDF
# Add OntoCAT (http://ontocat.sourceforge.net) wrapper for ConceptWiki using above (Morris,Despoina)
# Generate MOLGENIS frontend, including D2RQ interface, on top of ConceptWiki DB (Morris,Despoina)

== In-text concept recognition with linking to ConceptWiki and triple stores ==

=== Responsibilities ===
* Scientific Lead: Erik van Mulligen
* Technical support: [[User:Bharat Singh|Bharat Singh]], [[User:Dmitry Katsubo|Dmitry Katsubo]]

=== In-text highlighting of disambiguated triples ===
Erik's tool supports highlighting of triples in text and shows the connectedness of concepts within a context. We would like to link the highlighted concepts to ConceptWiki and then link them to his triple store to determine if the identified triple is already present in the triple store or is a new triple.

'''Action Points''' (Between square brackets are optional actions)
# Erik's source code, APIs, documents have to be clear and ready in the code base.
# ConceptWiki needs to expose a clear API. An easier alternative here is a little demo triplestore containing a set of (~100) protein-protein interactions identified using Hermen's software.
# The concept Ids need to be consistent for Nigam's and Erik's tools (concept wiki uuid?, or if bridgeDB is in placenigam and Erik can (or houdl fo rdemo purposes ? use different URO's for the same concept.

'''Actions'''

*  Develop a webservice that receives the fingerprint of one page and computes cooccurrence pairs within a sentence for concepts; use as example code the code as developed for the CWA prototype ([[User:Dmitry Katsubo|Dmitry]])
*  This same webservice will use Knewco's SOLR database with health relations to check if ambiguous concepts can be disambiguated and subsequently cooccurrence pairs are already existing in the SOLR database (triple store)'''Need to check if the DB will be allowed to be used in the hackathon context'''
*  Return a JSON message that contains triples and for each triple whether it is new or already defined in the triple store (and then provide information on the type of the relation and its weight) (Erik)
*  Extend the linker so that new relations/triples for a concept are shown in the linker with for each relation a checkbox ([[User:Bharat Singh|Bharat]])
* Integrate concept recognition feature into MOLGENIS using [http://ontocat.sourceforge.net OntoCAT] as concept source (Despoina, Morris)

Optional Steps: To be done if time allows
*  [Make available the thesaurus that has been used by Knewco for the health relations. Add to the thesaurus the protein concept identifiers used by Herman (Marc)]
*  [Add Hermans relations for proteins to the SOLR database (Erik/Herman)] 
*  [If checked, relations can be submitted back to the SOLR service and added to the SOLR database/triple store ([[User:Bharat Singh|Bharat]]/Erik)]

=== In-text concept recognition (MSWord and Excel) of unique or new triples ===
Proposed by Barend, Erik, and Nigam. Show the triple store derived information in MS Word or Excel. Nigam indicted they have an [http://bioportal.bioontology.org/annotator Excel] plug-in for which the code base could be used . A MSWord plug-in maybe ready by the time of the hackathon which also could be used. If necessary, there is already an  [http://ucsdbiolit.codeplex.com  MSWord] plugin developed by Microsoft and UCSD that recognizes concepts using ontologies from NCBO (the concept recognition is done within Word and the output is smart tags markup in Word).

''' use scenario'''
* Two concepts are recognized in a text (or excel spreadsheet).
* It is indicated whether these concepts have a previously determined relationship (as contained in the DB) or whether the relationship is new.

Optional 
* User can indicate new relationships that should be added to the DB

''' Action Points '''
# Get the triple store (from Erik?) ready: source code, APIs, documents have to be clear and ready in the code base.
# Get a text editor, e.g., MS word, (EXCEL) that supports highlighting and annotation popup. Get the relevant user manuals (if available)  as well.

'''TO DO'''

Christine will send roughly 10 sentences that contain concepts for which triples exist in Erik's triple store.
Erik (?) will send (or have ready at the hackathon) the service signature (preferably RESTful) that Excel or Word can POST to.
Nigam will do a dry run of:
* recognizing concepts (using the NCBO Annotator service) from sentences sent by Christine
* composing a service request for "check for a triple b/w these concepts"
* obtaining a response from the service and displaying it (in a browser or within Excel/Word).

== '''Enriching PDFs with the ConceptWiki''' ==

=== Responsible Persons ===
* Scientific Lead: Steve Pettifer
* Technical support: Leon, [[User:Dmitry Katsubo|Dmitry]]

=== Problem Statement ===
Many open access resources provide full text articles in PDF format. It would be great to highlight and link the concepts in PDF files to the ConceptWiki. Steve Pettifer at OMIIUK has an indredible de-PDFying tool and we might be able to this with PDFs. To carry this further it would be useful if in the de-PDFified documents links could then show the popup from the knowledge enhancer for more useability.

Steve's tool can convert pdfs to XML documents. We would then like to index these documents with Peregrine to identify the concepts. The concepts then can be linked to the ConceptWiki via the RDF which will in turn connect the concepts in the pdfs to the semantic web via the ConceptWiki. Adding back the Knowledge enhancer popup to the highlighted connected concepts in the pdfs would also give more functionality to the user.

=== Plans ===
# Prepare Peregrine, Knowledge enhancer and ConceptWiki developer documents
# Get "the de-PDFying tool" to a local code base.
# Identify a few data resources that provide full text articles in PDF format

= Participants =
(maximum 20)

'''Please indicate behind your name if you have registered and will be attending the NBIC conference'''

* Kees Burger (NBIC) (confirmed, registered for the NBIC conference)
* [[User:Rob Hooft|Rob Hooft]] (NBIC) (confirmed, Staying in Utrecht Friday night, conference:yes)
* [[User:Dmitry Katsubo|Dmitry Katsubo]] ([[NBIC]]) (''confirmed'')
* [[User:Leon | Hailiang (Leon) Mei]] (NBIC, confirmed, registered for the NBIC conference)
* Erik van Mulligen (confirmed Friday/most of Sat, EMC/Knewco)
* [[User:Bharat Singh|Bharat Singh]] ([[NBIC]]) (confirmed, registered for conference: yes)
* ''Nigam Shah'' (Stanford, will attend by skype)
* [[User:Mswertz | Morris Swertz]] (RUG/Lifelines/NBIC)(confirmed, need a room Friday night)
* Despoina Antonakaki (RUG/LifeLines/NBIC) (confirmed, friday only)
* ''Valery Tkachenko'' (Chemspider) (will not attend but may participate remotely)
* Marco Roos (LUMC)(confirmed)
* <s>Scott Marshal (Stanford/LUMC/W23C/HCLS)</s> 
* <s>Marc Weeber (Knewco)?</s>
* Steve Pettifer (OMIIUK, confirmed, staying in Utrecht)
* Phil McDermott (OMIIUK, confirmed, staying in Utrecht)
* Paul Groth (VU) (Friday, not at NBIC conference)
* ''Matthias Samwald'' (will participate remotely / via Skype, if this is possible)
* [[User:Agibson | Andrew Gibson]] (UvA, confirmed, not currently registered for NBIC conference)
* <s>Andrew Su</s> (GNF, apologies, will not be able to attend)
* <s>Martijn van Iersel (UNIMAAS) ?</s>
* Andra Waagmeester (UNIMAAS) (confirmed)
* <s>Herman van Haagen </s>(LUMC, no hackathon, oral presentation on Monday during NBIC meeting)
* <s>Martijn Schuemie ?</s>
* [[User:schultes|Erik Schultes]]  Duke & LUMC, registered and attending the NBIC conference
observers: 

* Barend Mons (LUMC/NBIC)
* <s>Frank van Harmelen ?</s>
* Anita de Waardt ?
* Christine Chichester : (confirmed, need room for Friday and reg for NBIC conference)

= Agenda & Location =

== Friday March 26 ==

Location: [http://www.surffoundation.nl/ SURF Foundation] (next to Central Station) [http://maps.google.nl/maps?f=q&hl=nl&q=Roggenweg+340,+3531+Utrecht,+Utrecht&sll=52.109879,5.066414&sspn=0.004098,0.007972&ie=UTF8&om=1&z=16&ll=52.088565,5.101883&spn=0.008201,0.022981&iwloc=addr Google map]
<pre>
Hojel City Center, gebouw D (5th floor)
Graadt van Roggenweg 340
3531 AH  Utrecht             T 030 234 66 00
Postbus 2290                 F 030 233 29 60
3500 GG UTRECHT              E info@surf.nl
</pre>

{| class="wikitable" border=1
 ! Time slot !! Responsible !! Type !! Subject
 |-
 | <div style="color:blue;">9:30-9:45</div>
 | Barend Mons
 | -
 | <div style="color:blue;">Welcome and purpose</div>
 |-
 | <div style="color:blue;">9:45-10:15</div>
 | Rob Hooft
 | -
 | <div style="color:blue;">Introductions</div>
 |-
 | <div style="color:blue;">12:00</div>
 | 
 | -
 | <div style="color:blue;">Lunch</div>
 |-
 | <div style="color:blue;">18:00-21:00</div>
 | -
 | -
 | <div style="color:green;">Dinner at Poort van kleef</div>
 |}

Address: Mariaplaats 7, 3511 LH Utrecht, 
Phone: +31 (0)30 231 80 84, 
Website: [http://www.poortvankleef.nl Poort van Kleef] ,[http://www.poortvankleef.nl/routekaartje.htm Map] ,
Reservation at 18:00 for 15 people under the name: Van Beemen
(if there are more or fewer they need to know before noon on Friday)

== Saturday March 27 ==

Location: alternative location, accross the road from SURF, Hogeschool Domstad, Koningsbergerstraat 9, Utrecht, [http://www.accommodatiedomstad.nl/contact/routebeschrijving Map]


{| class="wikitable" border=1
 ! Time slot !! Responsible !! Type !! Subject
 |-
 | <div style="color:blue;">9:30-9:45</div>
 | Barend Mons
 | -
 | <div style="color:blue;">Welcome and purpose</div>
 |-
 | <div style="color:blue;">12:00</div>
 | 
 | -
 | <div style="color:blue;">Lunch</div>
 |-
 | <div style="color:blue;">16:00-17:00</div>
 | -
 | -
 | <div style="color:green;">Preparation for the conference session</div>
 |}

== Hotel information ==

Hotel rooms booked for: 
* [[User:Rob Hooft|Rob Hooft]] 
* [[User:Mswertz | Morris Swertz]] 
* Steve Pettifer 
* Phil McDermott 
* Christine Chichester
* Andra Waagmeester  

Hotel information: 
NH Hotel
Jaarbeursplein 24
3521AR Utrecht
Tel: +31.30.2977977 
Fax: +31.30.2977999 
E-mail: nhutrecht@nh-hotels.com
[http://www.nh-hotels.nl/nh/nl/hotels/nederland/utrecht/nh-utrecht.html?action=search&stype=default&fini=&fout=&nadults1=2&nchilds1=0&services=&maxPrice=&searchLauncher=home&stext= Website]
reservation number: please ask Jacintha Valk-van Beemen via office@nbic.nl

= Attention =

* Try to get to know each other in advance, e.g., check CV, profiles, and technical level of each other.
* Identify goals very precisely and communicate them to the attendees in advance. It is best if attendees can share their design and implementation ideas based on the identified goals prior to the Hackathon.
* Make sure the HW/SW/Network are ready. 

= Final Checklist =
* <s>location (done)</s>
* <s>(wireless) network connection (available)</s>
* '''3 additional laptops for the video skype sessions with remote participants'''
*# I can bring one extra netbook with integrated wifi&webcam. --[[User:Leon|Leon]] 10:52, 21 March 2010 (CET)
*# Dmitry is taking a second laptop [[User:Rob Hooft|Rob Hooft]] 09:11, 25 March 2010 (CET)
* <s>a sandbox environment/server (Rob Hooft/BioAssist)</s>. Done: I have a rackspacecloud account and will be able to create sandbox servers on demand in minutes with anywhere between 256MB and 16GB of memory and any of 15 different Linux systems installed. [[User:Rob Hooft|Rob Hooft]] 21:23, 2 March 2010 (CET)
* a local code base
* <s>drinks and food (done) </s> 
* <s>reservation hotel rooms (done)</s>
* <s>determine who will stay on for NBIC conference (done)</s>

= Evaluation from the BioAssist Engineering Team =

== What Went Well ==

* Exciting results
* Great people
* Dinner
* Well planned division of tasks
* Remaining freedom for project assignments
* Focussed development

== Take A Look At ==

* Development capacity to follow up on the results
* The end of the second day died out slowly
* People that could not stay both full days
* Taking up a Saturday
* Preparations took a lot of unplanned time, throwing our Agile cycle in jeopardy
* Do not stick to the semantic focus next time: either more diverse subjects, or another focus.

[[Category:Interoperability / Events]]