Fish4Knowledge: Collecting and Analyzing Massive Coral Reef Fish Video Data

This book gives a start-to-finish overview of the whole Fish4Knowledge project, in 18 short chapters, each describing one aspect of the project. The Fish4Knowledge project explored the possibilities of big video data, in this case from undersea video. Recording and analyzing 90 thousand hours of video from ten camera locations, the project gives a 3 year view of fish abundance in several tropical coral reefs off the coast of Taiwan. The research system built a remote recording network, over 100 Tb of storage, supercomputer processing, video target detection and tracking, fish species recognition and analysis, a large SQL database to record the results and an efficient retrieval mechanism. Novel user interface mechanisms were developed to provide easy access for marine ecologists, who wanted to explore the dataset. The book is a useful resource for system builders, as it gives an overview of the many new methods that were created to build the Fish4Knowledge system in a manner that also allows readers to see how all the components fit together.

Provides a rare opportunity to gain an overview of relevant, supportive, inter-disciplinary and innovative research and technical works on Big Data in Marine Biology in one place This book is also a useful reference book for researchers and practitioners who are interested in handling big data that may be gathered from the Web or the natural world Includes various software components which are provided under open-source licenses that interested readers can potentially re-use for their own purposes The user interface developed will also be available, enabling readers to investigate their own marine biology questions Includes supplementary material: sn.pub/extras

Inhalt

Overview of the Fish4Knowledge Project.- User Information Needs.- Supercomputing Resources.- Marine Video Data Capture and Storage.- Logical Data Resource Storage.- Software Architecture with Flexibility for the Data-Intensive Fish4Knowledge Project.- Fish4Knowledge Database Structure, Creating and Sharing Scientific Data).- Intelligent Workflow Management for Fish4Knowledge using the SWELL System.- Fish Detection.- Fish Tracking.- Hierarchical Classification System with Reject Option for Live Fish Recognition.- Fish Behavior Analysis.- Understanding Uncertainty Issues in the Exploration of Fish Counts.- Data Groundtruthing and Crowdsourcing.- Counting on Uncertainty: Obtaining Fish Counts from Machine Learning Decisions.- Experiments with the Full Fish4Knowledge Dataset.- The Fish4Knowledge Virtual World Gallery.- Conclusions.