SparkGOR: A unified framework for genomic data analysis
Our goal was to combine the capabilities of Spark and GOR into a single computing framework for use in analysis of large scale genome data. We have created a relational query engine that unites SparkSQL and GORpipe into a single declarative query framework. This has been achieved by allowing embedding of SQL expressions into the high-level relational statement syntax in GOR and by supporting virtual relations and nested GORpipe expressions within SQL. Furthermore, we have built drivers to enable Spark and GOR to use and leverage their preferred file formats, Parquet and GORZ respectively, and introduced APIs to allow the use of GOR with Spark dataframes.
Availability: The SparkGOR version of the GORpipe software is open-source and freely available at here and here.
This website stores cookies on your computer. Some of these cookies enable this website to function and some of these cookies are used to collect information about how you interact with our website and allow us to remember you. We use this information in order to improve and customize your browsing experience and for analytics and metrics about our visitors both on this website and other media. To find out more about the cookies we use, see our Cookie Policy and Privacy Policy.
