An extensible light-weight XML-based monitoring system for sequence - - PowerPoint PPT Presentation

an extensible light weight xml based monitoring system
SMART_READER_LITE
LIVE PREVIEW

An extensible light-weight XML-based monitoring system for sequence - - PowerPoint PPT Presentation

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion An extensible light-weight XML-based monitoring system for sequence databases Dieter Van de Craen 1 Frank Neven 1 Kerstin Koch


slide-1
SLIDE 1

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

An extensible light-weight XML-based monitoring system for sequence databases

Dieter Van de Craen1 Frank Neven1 Kerstin Koch1

1Hasselt University and Transnational University of Limburg

22 July 2006

slide-2
SLIDE 2

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Motivation

Genbank

update update

. . .

update

? Question: Is there a gene with high similarity to my sequence ?

slide-3
SLIDE 3

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Motivation

Existing Solutions Alerting Systems

BioMail, Jade, Science Direct: literature PubCrawler: PubMed, Genbank

XML filtering systems

XFilter, YFilter, XMLTK: no full XPath

slide-4
SLIDE 4

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Monitoring System

Goals light-weight: locally installed extensible: XML/XPath-based user-friendly: web-interface efficient

slide-5
SLIDE 5

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Outline

1

Motivation

2

Introduction to XML and XPath

3

System Overview

4

Evaluation Brute Force XML Streaming Query Containment

5

Experiments

6

Incremental Maintenance

7

Conclusion

slide-6
SLIDE 6

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

XML and XPath

eXtensible Markup Language:

standard for data exchange on the Web, XML formats for biological data: BSML, GO-XML,. . .

<Feature-table title="Features"> ... <Qualifier value="genomic DNA" value-type="mol_type"/> ... </Feature-table>

XPath:

XML pattern language for locating information in XML documents Examples:

//Qualifier[@value-type="mol_type"]/@value boolean(//Qualifier[@value-type="mol_type" and contains(@value,"DNA"])

slide-7
SLIDE 7

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

System Overview

Request Evaluator Alignment Module Report Generator Evaluation Module WWW interface QueryTranslation Input Module DB local repository BioDBInterface XML Converter Update Module SwissProt PDB . . . GenBank

slide-8
SLIDE 8

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

System Overview

WWW interface QueryTranslation

Input Module

WWW Interface Query Translator

slide-9
SLIDE 9

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

System Overview

WWW interface QueryTranslation

Input Module

WWW Interface Query Translator = ⇒

Blast ID sequence Evalue wordsize MatchSize ... 51 gcagtgcc... 10 11 20 ... Mapping ID variable querytype keyword value ... 51 v_51_1 contains classifi cation fi sh 51 v_51_2 contains tissue_type brain 51 v_51_3 equals molecular_type mRNA ... Query ID userID database formula ... 51 8 genbank v_51_1 & v_51_2 & v_51_3 ...

slide-10
SLIDE 10

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

System Overview

Request Evaluator Alignment Module Report Generator Evaluation Module

Request Evaluator: evaluates metadata constraints of the requests on the update Alignment Module: alings every selected sequence with the corresponding source sequences Report Generator

slide-11
SLIDE 11

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

System Overview

BioDBInterface XML Converter

Update Module

BioDBInterface: checks availability of updates XML Converter

slide-12
SLIDE 12

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Outline

1

Motivation

2

Introduction to XML and XPath

3

System Overview

4

Evaluation Brute Force XML Streaming Query Containment

5

Experiments

6

Incremental Maintenance

7

Conclusion

slide-13
SLIDE 13

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Evaluation

Input: set of monitoring requests, set of records in the update Evaluation

1

Compute which requests match which records in the update

2

For these matches align their sequences

3

Build a report if the alignment is satisfying

slide-14
SLIDE 14

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Evaluation

Input: set of monitoring requests, set of records in the update Evaluation

1

Compute which requests match which records in the update

2

For these matches align their sequences

3

Build a report if the alignment is satisfying Bottleneck: Step 1

slide-15
SLIDE 15

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Evaluation

Evaluation Strategies:

1

Brute force

2

XML Streaming

3

Query Containment

slide-16
SLIDE 16

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Brute Force

Test every metadata constraint for every entry in the update Evaluation of the XPath expressions: Xalan

slide-17
SLIDE 17

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

XML Streaming

XML stream query processing systems offer efficient XPath evaluation, but support a limited fragment Idea: proceed in two steps:

1

retreive all the values for search fields for a record in the update using YFilter = ⇒ complex value representation

2

evaluate the metadata constraints on this complex value representation

slide-18
SLIDE 18

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

XML Streaming

  • rganism.contains(‘Oncorhynchus’)

AND molecular_type.contains(‘mRNA’)

1 YFilter 2 Evaluation

f values

  • rganism

{“Oncorhynchus mykiss”} accession { “AM181351” } keyword { “vitronectin protein 1”, “vtn1 gene” } molecular type {“mRNA”} . . . . . .

slide-19
SLIDE 19

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Query Containment

Idea: related topics of research will lead to related metadata constraints = ⇒ query containment: a constraint p ⊆ a constraint p′ if a record r satisfies p, r will also satisfy p′ Example:

  • rganism.equals(‘Oncorhynchus mykiss’) AND molecular_type.contains(‘mRNA’)

  • rganism.contains(‘Oncorhynchus’)

Query containment reduces to unsatisfiability of propositional logical formulas: CONP-complete = ⇒ Limmat

slide-20
SLIDE 20

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Containment DAG

a ∧ b ∧ c a ∧ b ∧ d a ∧ b a b d ⊆ ⊆ ⊆ ⊆ ⊆ node: set of equivalent constraints edge

n n′ ⊆

if every contraint in n is contained in every constraint in n′

slide-21
SLIDE 21

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Containment DAG

metadata constraints: a, b, d, a ∧ b, a ∧ b ∧ c and a ∧ b ∧ d

slide-22
SLIDE 22

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Containment DAG

metadata constraints: a, b, d, a ∧ b, a ∧ b ∧ c and a ∧ b ∧ d a b d

slide-23
SLIDE 23

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Containment DAG

metadata constraints: a, b, d, a ∧ b, a ∧ b ∧ c and a ∧ b ∧ d a ∧ b a b d ⊆ ⊆

slide-24
SLIDE 24

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Containment DAG

metadata constraints: a, b, d, a ∧ b, a ∧ b ∧ c and a ∧ b ∧ d a ∧ b ∧ c a ∧ b a b d ⊆ ⊆ ⊆

slide-25
SLIDE 25

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Containment DAG

metadata constraints: a, b, d, a ∧ b, a ∧ b ∧ c and a ∧ b ∧ d a ∧ b ∧ c a ∧ b ∧ d a ∧ b a b d ⊆ ⊆ ⊆ ⊆ ⊆

slide-26
SLIDE 26

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Containment DAG

metadata constraints: a, b, d, a ∧ b, a ∧ b ∧ c and a ∧ b ∧ d a ∧ b ∧ c a ∧ b ∧ d a ∧ b a b d ⊆ ⊆ ⊆ ⊆ ⊆

Observations:

1

  • nly one constraint is evaluated for a set of equivalent

constraints

2

if a record r matches a constraint in node n then all constraints in descendant nodes of n match r

3

if a record r does not match a constraint in node n then all constraints in ancestor nodes of n do not match r

slide-27
SLIDE 27

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Containment DAG

metadata constraints: a, b, d, a ∧ b, a ∧ b ∧ c and a ∧ b ∧ d a ∧ b ∧ c a ∧ b ∧ d a ∧ b a b d ⊆ ⊆ ⊆ ⊆ ⊆

Observations:

1

  • nly one constraint is evaluated for a set of equivalent

constraints

2

if a record r matches a constraint in node n then all constraints in descendant nodes of n match r

3

if a record r does not match a constraint in node n then all constraints in ancestor nodes of n do not match r

slide-28
SLIDE 28

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Containment DAG

metadata constraints: a, b, d, a ∧ b, a ∧ b ∧ c and a ∧ b ∧ d a ∧ b ∧ c a ∧ b ∧ d a ∧ b a b d ⊆ ⊆ ⊆ ⊆ ⊆

Observations:

1

  • nly one constraint is evaluated for a set of equivalent

constraints

2

if a record r matches a constraint in node n then all constraints in descendant nodes of n match r

3

if a record r does not match a constraint in node n then all constraints in ancestor nodes of n do not match r

slide-29
SLIDE 29

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Optimizations

1

false propagation: start at the sinks, if a node does not match a record propagate this to its ancestors

2

true propagation: start at the sources, if a node matches a record propagate this to its descendants a ∧ b ∧ c a ∧ b ∧ d a ∧ b a b d ⊆ ⊆ ⊆ ⊆ ⊆

slide-30
SLIDE 30

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Optimizations

1

false propagation: start at the sinks, if a node does not match a record propagate this to its ancestors

2

true propagation: start at the sources, if a node matches a record propagate this to its descendants a ∧ b ∧ c a ∧ b ∧ d a ∧ b a b d true false true ⊆ ⊆ ⊆ ⊆ ⊆

slide-31
SLIDE 31

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Optimizations

1

false propagation: start at the sinks, if a node does not match a record propagate this to its ancestors

2

true propagation: start at the sources, if a node matches a record propagate this to its descendants a ∧ b ∧ c a ∧ b ∧ d a ∧ b a b d true false true false false false ⊆ ⊆ ⊆ ⊆ ⊆

slide-32
SLIDE 32

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Optimizations

1

false propagation: start at the sinks, if a node does not match a record propagate this to its ancestors

2

true propagation: start at the sources, if a node matches a record propagate this to its descendants a ∧ b ∧ c a ∧ b ∧ d a ∧ b a b d ⊆ ⊆ ⊆ ⊆ ⊆

slide-33
SLIDE 33

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Optimizations

1

false propagation: start at the sinks, if a node does not match a record propagate this to its ancestors

2

true propagation: start at the sources, if a node matches a record propagate this to its descendants a ∧ b ∧ c a ∧ b ∧ d a ∧ b a b d false false ⊆ ⊆ ⊆ ⊆ ⊆

slide-34
SLIDE 34

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Optimizations

1

false propagation: start at the sinks, if a node does not match a record propagate this to its ancestors

2

true propagation: start at the sources, if a node matches a record propagate this to its descendants a ∧ b ∧ c a ∧ b ∧ d a ∧ b a b d false false false true ⊆ ⊆ ⊆ ⊆ ⊆

slide-35
SLIDE 35

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Optimizations

1

false propagation: start at the sinks, if a node does not match a record propagate this to its ancestors

2

true propagation: start at the sources, if a node matches a record propagate this to its descendants a ∧ b ∧ c a ∧ b ∧ d a ∧ b a b d true true false false false true ⊆ ⊆ ⊆ ⊆ ⊆

slide-36
SLIDE 36

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Outline

1

Motivation

2

Introduction to XML and XPath

3

System Overview

4

Evaluation Brute Force XML Streaming Query Containment

5

Experiments

6

Incremental Maintenance

7

Conclusion

slide-37
SLIDE 37

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Experiments

3 types of containment DAGs:

1

T1: for false propagation, sinks are the most general, upwards subsequently refi ned, only AND

2

T2: for true propagation, sources are the most restricted, downwards subsequently relaxed, only AND

3

R: created by random constraints, AND, OR, NOT, ( )

constraints created by extracting values out of updates number of requests: 1000 till 5000

slide-38
SLIDE 38

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Experimental Results: 5000 monitoring requests, update of 105 records

100 1000 10000 100000 1e+06 1e+07 R T2 T1 Evaluation Time (sec) Type of Graph Evaluation Time False Propagation True Propagation Streaming Brute Force

Figure: Average evaluation time in seconds

T1 T2 R False propagation 0.5% 52% 38% True propagation 99% 99% 93% Streaming 100% 100% 100% Brute force 100% 100% 100%

Figure: Average percentage of

evaluated nodes in the DAG

slide-39
SLIDE 39

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Comparison with a relational database approach

Idea: parse the XML into a relational database and use the database mechanisms for querying Queries: 1000 random queries in CNF

# clauses: 1 to 5 # literals per clause: 1 to 3 constraints created by extracting values out of updates

experiments done with MySQL

slide-40
SLIDE 40

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Comparison with a relational database approach

1 2 3 4 5 Relational Database Evaluation Time (sec) 0.4 0.41 0.42 0.43 0.44 0.45 0.46 0.47 0.48 0.49 0.5 Streaming

Figure: Boxplot of the evaluation time per query for 105 records

slide-41
SLIDE 41

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Comparison with a relational database approach

Relational database

Loading the update into the DB: 655 sec Evaluation: 1803 sec Total: 2461 sec

Streaming

Constructing complex values of the update: 230 sec Evaluation: 438 sec Total: 673 sec

Advantages Streaming:

± constant evaluation time per query less overhead

slide-42
SLIDE 42

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Outline

1

Motivation

2

Introduction to XML and XPath

3

System Overview

4

Evaluation Brute Force XML Streaming Query Containment

5

Experiments

6

Incremental Maintenance

7

Conclusion

slide-43
SLIDE 43

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

containment DAG is independent of the updates maintained incrementally: deletion and insertion of monitor requests

slide-44
SLIDE 44

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

1

Deletion

1

Locate the corresponding node

2

Remove the constraint, if the node is empty add edges from the parents to the children

Deletion of a ∧ b a ∧ b ∧ c a ∧ b ∧ d a ∧ b a b d ⊆ ⊆ ⊆ ⊆ ⊆

slide-45
SLIDE 45

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

1

Deletion

1

Locate the corresponding node

2

Remove the constraint, if the node is empty add edges from the parents to the children

Deletion of a ∧ b a ∧ b ∧ c a ∧ b ∧ d a ∧ b a b d ⊆ ⊆ ⊆ ⊆ ⊆

slide-46
SLIDE 46

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

1

Deletion

1

Locate the corresponding node

2

Remove the constraint, if the node is empty add edges from the parents to the children

Deletion of a ∧ b a ∧ b ∧ c a ∧ b ∧ d a b d ⊆ ⊆ ⊆ ⊆ ⊆

slide-47
SLIDE 47

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆

slide-48
SLIDE 48

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆? ⊆?

slide-49
SLIDE 49

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆

slide-50
SLIDE 50

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆? ⊆?

slide-51
SLIDE 51

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆

slide-52
SLIDE 52

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆? ⊆?

slide-53
SLIDE 53

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆

slide-54
SLIDE 54

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆? ⊆? ⊆? ⊆?

slide-55
SLIDE 55

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆

slide-56
SLIDE 56

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆? ⊆? ⊆?

slide-57
SLIDE 57

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆

slide-58
SLIDE 58

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆?

slide-59
SLIDE 59

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆

slide-60
SLIDE 60

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆

slide-61
SLIDE 61

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆

slide-62
SLIDE 62

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion of a constraint a ∧ b ∧ c Idea: compute initial upper and lower borders, U and L, and gradually refine them a ∧ b ∧ c ∧ d a ∧ b ∧ c ∧ e a ∧ b ∧ c ∧(d ∨ e) a ∧ b ∧ c c ∧ e a ∧ b b ∧ c a b c e ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆ ⊆

slide-63
SLIDE 63

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Incremental Maintenance

2

Insertion

expensive: add a constraint to a containment DAG containing 1250 nodes: 15 sec 2500 nodes: 30 sec 5000 nodes: 60 sec bottleneck: complexity of the containment check solution: transform constraints into DNF ⇒ 25% increase in size construction containment DAG with 5000 nodes: 60 sec

slide-64
SLIDE 64

Motivation Introduction to XML and XPath System Overview Evaluation Experiments Incremental Maintenance Conclusion

Conclusion

Main Results

developed XSeqM, an extensible, light-weight monitoring system for biological databases experimentally valited our evaluation method

Future Work

Deploy the system Test the system on real world data Further optimize the false propagation method on containment DAGs of type R: OBDD