Base de Dados Multimédia Inteligentes!

Transcrição

1 Base de Dados Multimédia Inteligentes! Andreas Wichert!! MEIC Tagus! (Página da cadeira: Fenix)!! Objectivo Geral! n Esta cadeira irá apresentar técnicas e algoritmos relevantes para o desenvolvimento e implementação de sistemas inteligentes de bases de dados de multimedia! n Irá incluir tópicos técnicos tais como compressão, origem e papel desempenhado por metadata assim também como multimédia e SQL! n Problemas relativos à manipulação de dados multimédia, em particular em relação a questionar (content based information retrieval) índices e sumários serão abordados! 1

2 n Organization! n Program! n Introduction! n Querying Multimedia Databases! n Application Examples! Corpo docente! n Andreas Wichert - Teóricas / Práticas! n andreas.wichert@ist.utl.pt!!! n andreas.wichert@inesc-id.pt! 2

3 Organização das aulas! n Teóricas:! n Matéria (slides baseados no livro e artigos e...)! n Práticas/Laboratório (weekly!):! n Exercícios! n Software Experiments! Avaliação! n Problemas praticas (Exercícios) (40%)! n +! n Exame orais (60%)! 3

4 Horário de dúvidas! n 3ª feira: 14H-17H (gabinete 2N5.7)! Bibliografia (Main)! n Lynne Dunckley. Multimedia Databases, An Object-Rational Approach. Addison Wesley, 2003! 4

5 Bibliografia! n Fred Halsall. Multimedia Communications: Applications, Networks, Protocols and Standards. Addison Wesley, 2001! Bibliografia! n Christos Faloutsos. Modern information retrieval. In Ricard Baeza-Yates and Berthier Ribeiro-Neto, editors, Modern Information Retrieval, chapter 12, pages Addison-Wesley, 1999.! 5

6 n C. Böhm, S. Berchtold, and A. Keim Kei, D. Searching in highdimensional spaces index structures for improving the performance of multimedia databases. ACM Computing Surveys, 33(3): , 2001.! Journals & Book Chapter! n n n n n Wichert A.: Content-based image retrieval by hierarchical linear subspace method, Journal of Intelligent Information Systems, 31 (1): , 2008 doi: / s ! Santos P., Galhardas H., Wichert A.. Panoramix: A Content-based Health Record System, Internal Journal of Computer Assisted Radiology and Surgery: 4 (Supplement): 152, 2009 doi:0.1007/s y! Andreas Wichert, Pedro Teixeira, Pedro Santos, Helena Galhardas: Subspace tree: High dimensional multimedia indexing with logarithmic temporal complexity, Journal of Intelligent Information Systems, 35 (3): , 2010 doi: / s ! Andreas Wichert and Pedro Santos: Fast multimedia querying for medical applications, Eds. Claudia Plant and Christian Bohm, Chapter in Database Technology for Life Sciences and Medicine,World Scientific Publishing, pp : 2010! Andreas Wichert and Andre Verissimo: CBIR with a Subspacee-tree: Principal Component Analysis versus Averaging, Multimedia Systems, in press doi: / s ! 6

7 Projects! n HEIDI (HEIGH Dimensional Indexing) or how to index on billion of vectors! n indexação de elevada dimensão, conjectura "a maldição da árvore, métrica indexação com subespaços hierárquicos! Programa! n 1.!!Introduction, examples! n 2.!!Multimedia Data! n 3.!!Tools: DFT/Wavelets! n 4.!!Compression, Image, MPEG audio! n 5.!!Video MPEG -1, -2, -4! n 6.!!Introduction to DB, Multimedia and SQL! 7

8 Programa!! n 7.! n 8.!!Human visual system!!human acoustic system! n 9.!!Content Based Multimedia!!!!Retrieval! n 10.!!Multimedia metadata (MPEG 7)! n 11.!!Feature Selection and Extraction! Programa! n 12.!Primary key, B-trees! n 13.!Multi key Indexing, Inverted!!!indices, k-d-trees, z-ordering! n 14.! n 15.! n 16.!!R-trees, Grid files, Metric trees!!gemini!!subspace method! 8

9 Programa! n 17.!!Text indexing! n 18.!!Singular Value!!!!!Decomposition! n 19.!!Querying and Information!!!fusion! Programa! n 21.! n 22.!!Associative Memory!!Semantic Modeling! n 23.!!Multimedia Database Architecture! n 24.!!Client server system and storage!!!parameters! 9

10 9/17/13 Programa! n 25.!Multimedia and the Internet! n Course ends around 13. Dec.! Introduction! n In the past! n n Modern times! n n Humans represented information through images! Dominance of text! This century! n Nature of documents and information is changing..! 10

11 n Human brain is more efficient at processing and interpreting visual and audio information! n In dealing with multimedia information we are dealing with! n digital data representations! n how these data can be stored and manipulated! n Provide more functions than would be available in traditional forms of data! 11

12 n Early applications of multimedia database management systems MMDBMS tend to use multimedia for presentational requirements only! n A sales order processing system could include an online catalog that includes a picture of the products offered! n The image would be retrieved by an application process which referenced it through a traditional database record! What is essential about database systems?! n Users of a database system expect to be able to manipulate the data to obtain useful output! n Insert new data! n Retrieve and change existing data! n Delete data! 12

13 What is different about Multimedia Data! n Size! n A good quality colored image 6MB! n With 30 frames per sec., five min. video clip would require 54 GB! n Time! n Video, Music! n Semantic nature of multimedia! Querying multimedia Database n How to pose a query? n How to search? n What information can be retrieved? n How the information can be retrieved? 13

14 n Allow new access of data! n Query by images:! Find the most similar image to the presented image! Find images which may indicate an illness! medgift è Emphysem Emphysem Anfragebild Macro nodules Micro nodules 14

15 n Allow new access of data! n Query by films! Find the most similar filmed operation to the present one! 15

16 Multimedia Applications! n Entertainment Systems! n Pubilc protection! n Medical information Systems! 16

17 n Thomas Blessington, a sixteen-year-old from Bradford who was arrested for shopbreaking 1901 n The use of photography to record known criminals - the 'mug shot'- had been suggested as early as the 1840s. Intelligent multimediadatabases for medicine! n Images are kept with patients record stored by unique identifiers! n browse and navigate their way through collection of multimedia objects such as digital images n How does my patient's tumor look compared to other similar cases 17

18 18

19 Homework! n Go to...! n n Famous Imperial Museum in St.Petersburg Russia!! 19

20 n Bioinformatics! n Chemistry! n Astronomy! n Organization! n Program! n Introduction! n Querying Multimedia Databases! n Application Examples! 20