Community

MarkLogic 10 and Data Hub 5.0

Latest MarkLogic releases provide a smarter, simpler, and more secure way to integrate data.

Read Blog →

Company

Stay On Top Of Everything MarkLogic

Be the first to know! News, product information, and events delivered straight to your inbox.

Sign Me Up →

 
Knowledgebase: MarkLogic Server
Loading Data into MarkLogic Server
04 January 2017 02:03 PM

Summary

There are many different options when loading data into MarkLogic. The best option for your particular circumstances will depend on your use case.

Details

Version Compatibility

Not all features/programs are provided or are compatible with all versions of MarkLogic.  Check the requirements given.  Note that the MarkLogic documentation at docs.marklogic.com allows you to select the version of the documentation that you view.

For version 6 and above there is a separate guide:  Loading Content Into MarkLogic Server.

MLCP

MarkLogic Content Pump (mlcp) is an open-source, Java-based command-line tool. mlcp helps to import, export, and copy data to or from MarkLogic databases. It is designed for integration and automation in existing workflows and scripts.

See MarkLogic Content Pump for details.

REST API

In MarkLogic 6 and above, the MarkLogic REST API provides a set of RESTful services for creating, updating, retrieving, deleting and query documents and metadata.  See REST Development for details.

Java API

The Java Client API is an open source API for creating applications that use MarkLogic Server for document and search operations.

Node.js

The Node.js Client API enables you to create Node.js applications that can read, write, and query documents and semantic data in a MarkLogic database. See Node.js Application Developer's Guide.

Hadoop

The MarkLogic Server Hadoop MapReduce Connector provides an interface for using a MarkLogic Server instance as a MapReduce input source and/or a MapReduce output destination.

See MarkLogic Connector for Hadoop Developer's Guide.

XQuery

You can load documents into the database using the XQuery load document functions, as described in Loading Content Using XQuery in the guide to loading content.

WebDav

You can set up a WebDAV server and client to load documents. See WebDAV Servers for more information.

RecordLoader

RecordLoader is a Java-based command line tool, designed to load any number of arbitrary-sized input documents into a MarkLogic database.

Corb

Corb is a Java-based command line tool for content reprocessing in bulk. 

XQSync

XQSync is a command-line, Java-based tool, useful for synchronizing MarkLogic databases to and from other databases, filesystems, and zip-files.

AutoLoader

AutoLoader is a Java-based tool that monitors a directory for new files. These files are then automatically loaded into MarkLogic server via RecordLoader.

XCC Application 

Documents can also be loaded into the database by an XCC application, as described in the XCC Developer’s Guide.

(3 vote(s))
Helpful
Not helpful

Comments (1)
Dave Cassel
23 September 2014 11:57 AM
This page could use an update to discuss mlcp and the REST API.