Loading Data into MarkLogic Server
04 January 2017 02:03 PM
There are many different options when loading data into MarkLogic. The best option for your particular circumstances will depend on your use case.
Not all features/programs are provided or are compatible with all versions of MarkLogic. Check the requirements given. Note that the MarkLogic documentation at docs.marklogic.com allows you to select the version of the documentation that you view.
For version 6 and above there is a separate guide: Loading Content Into MarkLogic Server.
MarkLogic Content Pump (mlcp) is an open-source, Java-based command-line tool. mlcp helps to import, export, and copy data to or from MarkLogic databases. It is designed for integration and automation in existing workflows and scripts.
See MarkLogic Content Pump for details.
In MarkLogic 6 and above, the MarkLogic REST API provides a set of RESTful services for creating, updating, retrieving, deleting and query documents and metadata. See REST Development for details.
The Java Client API is an open source API for creating applications that use MarkLogic Server for document and search operations.
The Node.js Client API enables you to create Node.js applications that can read, write, and query documents and semantic data in a MarkLogic database. See Node.js Application Developer's Guide.
The MarkLogic Server Hadoop MapReduce Connector provides an interface for using a MarkLogic Server instance as a MapReduce input source and/or a MapReduce output destination.
You can load documents into the database using the XQuery load document functions, as described in Loading Content Using XQuery in the guide to loading content.
You can set up a WebDAV server and client to load documents. See WebDAV Servers for more information.
RecordLoader is a Java-based command line tool, designed to load any number of arbitrary-sized input documents into a MarkLogic database.
Corb is a Java-based command line tool for content reprocessing in bulk.
XQSync is a command-line, Java-based tool, useful for synchronizing MarkLogic databases to and from other databases, filesystems, and zip-files.
Documents can also be loaded into the database by an XCC application, as described in the XCC Developer’s Guide.