2021:CMIS Connection (Node Type): Difference between revisions

From Grooper Wiki
No edit summary
No edit summary
Line 74: Line 74:


This tutorial will use the ''NTFS'' binding as its example, connecting to a networked Windows File System folder.
This tutorial will use the ''NTFS'' binding as its example, connecting to a networked Windows File System folder.
{|cellpadding="10" cellspacing="5"
|-style="background-color:#36b0a7; color:white"
|style="font-size:14pt"|'''FYI'''||'''CMIS Connections''' changed somewhat in Grooper 2021.  In previous versions, these objects were added to a "CMIS Connections" folder inside the '''Infrastructure''' folder in the Node Tree.
Now, they are properly considered a "global resource", a Grooper object referenceable by other Grooper objects, such as '''Activities''' in a '''Batch Process'''.  As such, they are added to the '''Global Resources''' folder in the Node Tree.
|}


<tabs style="margin:20px">
<tabs style="margin:20px">
Line 80: Line 87:
=== Add the CMIS Connection ===
=== Add the CMIS Connection ===


'''CMIS Connections''' are created and configured in the '''Infrastructure''' folder of the Grooper Node Tree.
'''CMIS Connections''' are created and configured in the '''Global Resources''' folder of the Grooper Node Tree.


{|cellpadding=10 cellspacing=5
{|cellpadding=10 cellspacing=5
|style="width:40%" valign=top|
|style="width:40%" valign=top|
# Navigate to the '''CMIS Connections''' folder under the '''Infrastructure''' folder.
# Right click the '''Global Resources ''' folder.
# Right click the '''CMIS Connections''' folder.  Select "Add" and "CMIS Connection..."
# Select "Add" and "CMIS Connection..."
# This will bring up a window to name the '''CMIS Connection'''.  Name the '''CMIS Connection and press "OK" when finished.
# This will bring up a window to name the '''CMIS Connection'''.  Name the '''CMIS Connection''' and press "OK" when finished.
#* How you name this object is up to you.  However, it's a good idea to at least include which ''CMIS Binding'' you're going to use.  We're connecting to a Windows File System using the ''NTFS'' binding, hence our name "NTFS Example"
#* How you name this object is up to you.  However, it's a good idea to at least include which ''CMIS Binding'' you're going to use.  We're connecting to a Windows File System folder using the ''NTFS'' binding.  The folder's name is "Grooper Import Export".  Hence, our name "NTFS - Grooper Import Export"
|
|
[[File:Cmis-connection-how-to-01.png]]
[[File:2021-cmis-connection-how-to-01.png]]
|}
|}


Line 99: Line 106:
{|cellpadding=10 cellspacing=5
{|cellpadding=10 cellspacing=5
|style="width:40%" valign=top|
|style="width:40%" valign=top|
# This will create a new '''CMIS Connection''' object in the '''CMIS Connections''' folder.
# This will create a new '''CMIS Connection''' object in the '''Global Resources''' folder.
# Select the '''''Connection Type''''' property.
# Select the '''''Connection Type''''' property.
# Use the dropdown menu to select the desired ''CMIS Binding''.  This will be whatever input/output platform you choose to connect to.
# Use the dropdown menu to select the desired ''CMIS Binding''.  This will be whatever input/output platform you choose to connect to.
#* For the purposes of this tutorial, we are choosing ''NTFS'', connecting to the Windows File System.
#* For the purposes of this tutorial, we are choosing ''NTFS'', connecting to the Windows File System.
|
|
[[File:Cmis-connection-how-to-01.png]]
[[File:2021-cmis-connection-how-to-02.png]]
|}
|}
</tab>
</tab>
Line 117: Line 124:
# Expand the '''''Connection Settings''''' properties.
# Expand the '''''Connection Settings''''' properties.
# For the ''NTFS'' binding, select the '''''Repositories''''' property and press the ellipsis button at the end.
# For the ''NTFS'' binding, select the '''''Repositories''''' property and press the ellipsis button at the end.
# This will bring up a "Repository Configuration Collection Editor" for the ''NTFS'' binding.
# This will bring up the '''''Repositories'''' collection editor window for the ''NTFS'' binding.


{|cellpadding="10" cellspacing="5"
{|cellpadding="10" cellspacing="5"
Line 123: Line 130:
|style="font-size:22pt"|'''&#9888;'''||Each ''CMIS Binding'' has different connection settings required for connection.  Depending on the ''CMIS Binding'' chosen for the '''''Connection Type''''' this step will be configured differently.
|style="font-size:22pt"|'''&#9888;'''||Each ''CMIS Binding'' has different connection settings required for connection.  Depending on the ''CMIS Binding'' chosen for the '''''Connection Type''''' this step will be configured differently.


However, once connected, '''CMIS Connections''' are largely the same across ''CMIS Bindings''.
However, once connected, '''CMIS Connections''' are largely the same across ''CMIS Bindings''.  That's the whole point.  The '''CMIS Connection''' object allows for more standardized access to a variety of different storage platforms in terms of how Grooper interoperates with them.
|}
|}


|
|
[[File:Cmis-connection-how-to-03.png]]
[[File:2021-cmis-connection-how-to-03.png]]
|-
|-
|valign=top|
|valign=top|
# Press the "Add" button to add a new Windows folder location.
# Press the "Add" button to add a new Windows folder location.
# Use the '''''Base Path''''' property to enter a Windows File System folder path.
# Use the '''''Base Path''''' property to enter a Windows File System folder path.
#* Note:  Paths should be specified as UNC paths, as seen here.  Avoid mapped or local drive references.  Non-UNC paths may not be accessible to other users, machines or processes.
#* Note:  Windows folder paths should ''always'' be specified as UNC paths, as seen here.  Avoid mapped or local drive references.  Non-UNC paths may not be accessible to other users, machines or processes.
# Press the "Ok" button when finished.
# Press the "Ok" button when finished.
|
|
[[File:Cmis-connection-how-to-04.png]]
[[File:2021-cmis-connection-how-to-04.png]]
|}
|}
</tab>
</tab>
<tab name="Verify Repository Connection" style="margin:20px">
<tab name="Verify Repository Connection" style="margin:20px">
Line 152: Line 157:
#*# There are no accessible repositories in the assigned location.
#*# There are no accessible repositories in the assigned location.
|
|
[[File:Cmis-connection-how-to-05.png]]
[[File:2021-cmis-connection-how-to-05.png]]
|}
|}


Line 165: Line 170:
# Press the "Import Repository" button.
# Press the "Import Repository" button.
|
|
[[File:Cmis-connection-how-to-06.png]]
[[File:2021-cmis-connection-how-to-06.png]]
|-
|-
|valign=top|
|valign=top|
Line 173: Line 178:
You can now use this repository for import and export operations.  Grooper has full access to this folder location to bring in documents and export processed documents.
You can now use this repository for import and export operations.  Grooper has full access to this folder location to bring in documents and export processed documents.
|
|
[[File:Cmis-connection-how-to-07.png]]
[[File:2021-cmis-connection-how-to-07.png]]
|}
|}


Line 183: Line 188:
|style="width:40%" valign=top|
|style="width:40%" valign=top|
# Select the '''CMIS Repository''' object in the Node Tree.
# Select the '''CMIS Repository''' object in the Node Tree.
# While we're here, notice the "Content Types" window, listing '''File''' and '''Folder'''.
# You can use the "Browse Repository" tab to view the documents and folders inside the imported '''CMIS Repository'''.
#* These objects allow Grooper to do more advanced operations such as metadata import and export mapping.  The '''File''' object corresponds to documents and the '''Folder''' object corresponds to folders in the repository.  They exist as child objects of the '''CMIS Connection'''.
# If we double click the "Import" folder, we will open its contents, just like you would using the Windows File Explorer.
# The associated metadata for the '''File''' and '''Folder''' objects are listed in the "Content Type Properties" window.
 
#* The available properties here will change depending on the ''CMIS Binding'' used.  For example, the ''NTFS'' binding allows you to write filenames upon document export.  Therefore, there is a writable "Name" property.
{|cellpadding="10" cellspacing="5"
|-style="background-color:#36b0a7; color:white"
|style="font-size:14pt"|'''FYI'''||All storage platforms can be browsed in this manner via their corresponding ''CMIS Binding'', not just the ''NTFS'' binding.
|}
 
|
|
[[File:Cmis-connection-how-to-08.png]]
[[File:2021-cmis-connection-how-to-08.png]]
|-
|-
|valign=top|
|valign=top|
# You can use the "Browse Repository" tab to view the documents and folders inside the imported '''CMIS Repository'''.
 
# You can select documents in the list here.
# You can select documents in the repository as well.
# A preview of the document will populate in the "Document Viewer" window.
# A preview of the document will populate in the "Document Viewer" window.
You could even copy one or more files and paste them directly into a test '''Batch''' if you like.
|
|
[[File:Cmis-connection-how-to-10.png]]
[[File:2021-cmis-connection-how-to-09.png]]
|-
|-
|valign=top|
|valign=top|
Now that a connection is established, this '''CMIS Repository''' as a direct connection to the folder location.
Furthermore, now that a connection is established, this '''CMIS Repository''' as a direct connection to the folder location.


For example, if we are to add a folder in the Windows File System, the '''CMIS Repository''' will be aware of the change.
If we are to add a folder in the Windows File System, the '''CMIS Repository''' will be aware of the change.  You can even delete files, rename them, change editable properties, and cut/copy and paste items into folders, just like you can in the storage platform's native application.  You have control of the repository as if you were using it natively.
 
# For example, we could right-click the blank space in the repository browser and select "Add Folder".
# This brings up a new window to name the new folder.
#* Which we've named "Disposed"
# If you press "Execute" a new folder will be created.
|
|
[[File:Cmis-connection-how-to-11.png]]
[[File:2021-cmis-connection-how-to-10.png]]
|-
|-
|valign=top|
|valign=top|
# There's the new folder in our '''CMIS Repository'''.
That means it creates it in the connected storage platform as well!


You can even delete files, rename them, change editable properties, and cut/copy and paste items into folders, just like you can in the storage platform's native application.  You have control of the repository as if you were using it natively.
# In our case a windows folder named "Disposed" was created.
 
And the reverse would hold true as well, if we added a new folder (or new files) to the connected platform, Grooper would be aware of it via the '''CMIS Connection'''.
|
|
[[File:Cmis-connection-how-to-12.png]]
[[File:2021-cmis-connection-how-to-11.png]]
|}
|}
</tab>
</tab>
<tab name="Examining Type Definitions" style="margin:20px">
something something something
# While we're here, notice the "Content Types" window, listing '''File''' and '''Folder'''.
#* These objects allow Grooper to do more advanced operations such as metadata import and export mapping.  The '''File''' object corresponds to documents and the '''Folder''' object corresponds to folders in the repository.  They exist as child objects of the '''CMIS Connection'''.
# The associated metadata for the '''File''' and '''Folder''' objects are listed in the "Content Type Properties" window.
#* The available properties here will change depending on the ''CMIS Binding'' used.  For example, the ''NTFS'' binding allows you to write filenames upon document export.  Therefore, there is a writable "Name" property.
|
</tabs>
</tabs>



Revision as of 11:38, 24 September 2021

CMIS Connections allow Grooper to connect to external storage platforms for import and export operations.

Grooper is able to connect to a variety of storage platforms, from simple file systems (such as Windows native NTFS system), to email sources, to full-fledged content management systems. The CMIS Connection object allows you to configure connection settings, allowing Grooper to integrate import and export control. With these settings saved on a Grooper object, they are easily referenced by an Import Watcher service or Export Behaviors applied by the Export activity for automated batch processing.

Which platform is connected is defined by the CMIS Connection's Connection Type property. Once the connection is made to a specific storage location, called a "repository", Grooper has direct access to import and export documents from and to folder locations in the repository.

Furthermore, Grooper has import and export access to metadata available to the particular platform. For example, sender and receipt metadata from emails received from email servers. This also gives Grooper the ability to map extracted data elements from documents to corresponding data element locations in a content management system.


About CMIS

CMIS stands for "Content Management Interoperability Services".  It is an open standard that allows different content management systems to inter-operate over the Internet.  This standard protocol allows Grooper to use many different platforms for importing and exporting documents and their contents.  Once a CMIS Connection is created, Grooper can exchange documents with these platforms. "Interoperability " means Grooper has the same access to control the system as a human being does. It is a "one-to-one" connection to the platform, allowing full and total control.

Upon connecting to an external content management system, Grooper will be able to see the "repositories" associated with it.  A repository, in computer science, is a general term for a location where data lives. Different systems refer to "repositories" in different ways.  An email inbox could be a repository. A folder in Windows could be a repository. A cabinet in ApplicationXtender could be a repository. It's a place to put things. We standardize the various terms used by various storage platforms to simply "repository".

These repositories are "imported" into Grooper as a CMIS Repository object, created as a child of the CMIS Connection object. This doesn't import data into Grooper in the traditional sense of importing documents into a new Batch. "Importing" here is more like bringing the repository into a framework Grooper can use. Upon importing the repository, Grooper has full file access to that location in the storage platform.

For our purposes, repositories are like filing cabinets full of documents.  Once a connection is established, it's like giving Grooper a key to that cabinet.  You can open the various drawers of that cabinet. You can pull out files and put files into. The storage platform or content management system is like the cabinet.

  • The CMIS Connection object is like the key.
  • The CMIS Repository object is like a drawer in the cabinet.
  • You "connect" to the cabinet by turning the key. You "import" the repository by opening the drawer. Now you can see there are documents in there! You can take them out. You can read them and put them back in. You can put new ones in. You can use this "open" connection to the "drawer" however you need.

CMIS+ Architecture

Grooper expanded on this idea in version 2.72 to create our CMIS+ architecture. CMIS+ unifies all content platforms under a single framework as if they were traditional CMIS endpoints. Prior to version 2.72, there was only one type of CMIS Connection, a true CMIS connection using CMIS 1.0 or CMIS 1.1 servers. Now, connections to additional non-CMIS document storage platforms can be made via "CMIS Bindings". This provides standardized access to document content and metadata across a variety of external storage platforms.

Using this architecture, Grooper is able to create a simpler and more efficient import and export workflow, using a variety of storage platforms. You now use the CMIS Import Import Provider and the CMIS Export Export Type, regardless of the storage platform. They connect to a CMIS Repository imported from a CMIS Connection and use that as Grooper's import or export path.

How you create a CMIS Connection only differs from CMIS Binding to CMIS Binding, as each binding has a different way of connecting to it. You don't connect to an Outlook inbox the same way you connect to a Windows file folder, for example. Thus, the property configuration for the Exchange binding is different from the NTFS binding.

CMIS Bindings

A CMIS Binding provides connectivity to external storage platforms for content import and export. Grooper's CMIS+ architecture expands connectivity from traditional CMIS servers to a variety of on-premise and cloud-based storage platforms by exposing connections to these platforms as CMIS Bindings.

Each individual CMIS Binding contains the settings and logic required to exchange documents between Grooper and each distinct platform. For example, the AppXtender Binding contains all the information Grooper uses to connect to the ApplicationXtender content management system.

CMIS Bindings are used when creating a CMIS Connection object. The first step to creating a CMIS Connection is to configure the Connection Type property. Which binding you use (and therefore which platform you connect to) is set here. First, the user selects which CMIS Binding they want to use, selecting which storage platform they want to connect to. The second step is to enter the connection settings for that binding, such as login information for many bindings.

Current CMIS Bindings

Grooper can connect to the following storage platforms using below using CMIS Bindings:

How To

Create a CMIS Connection and Import a Repository

The following are very general instructions on how to add a CMIS Connection to Grooper. Which document storage platform you connect to is determined by the Connection Type property. For specific instructions on how to connect to specific document storage platforms, refer to each one's CMIS Binding article, linked below.

This tutorial will use the NTFS binding as its example, connecting to a networked Windows File System folder.

FYI CMIS Connections changed somewhat in Grooper 2021. In previous versions, these objects were added to a "CMIS Connections" folder inside the Infrastructure folder in the Node Tree.

Now, they are properly considered a "global resource", a Grooper object referenceable by other Grooper objects, such as Activities in a Batch Process. As such, they are added to the Global Resources folder in the Node Tree.

Add the CMIS Connection

CMIS Connections are created and configured in the Global Resources folder of the Grooper Node Tree.

  1. Right click the Global Resources folder.
  2. Select "Add" and "CMIS Connection..."
  3. This will bring up a window to name the CMIS Connection. Name the CMIS Connection and press "OK" when finished.
    • How you name this object is up to you. However, it's a good idea to at least include which CMIS Binding you're going to use. We're connecting to a Windows File System folder using the NTFS binding. The folder's name is "Grooper Import Export". Hence, our name "NTFS - Grooper Import Export"

Select the CMIS Binding

  1. This will create a new CMIS Connection object in the Global Resources folder.
  2. Select the Connection Type property.
  3. Use the dropdown menu to select the desired CMIS Binding. This will be whatever input/output platform you choose to connect to.
    • For the purposes of this tutorial, we are choosing NTFS, connecting to the Windows File System.

Configure the Connection Settings

The Connection Settings will be configured differently depending on which CMIS Binding is selected. The settings shown here are specifically for the NTFS binding.

  1. Expand the Connection Settings properties.
  2. For the NTFS binding, select the Repositories property and press the ellipsis button at the end.
  3. This will bring up the Repositories' collection editor window for the NTFS binding.
Each CMIS Binding has different connection settings required for connection. Depending on the CMIS Binding chosen for the Connection Type this step will be configured differently.

However, once connected, CMIS Connections are largely the same across CMIS Bindings. That's the whole point. The CMIS Connection object allows for more standardized access to a variety of different storage platforms in terms of how Grooper interoperates with them.

  1. Press the "Add" button to add a new Windows folder location.
  2. Use the Base Path property to enter a Windows File System folder path.
    • Note: Windows folder paths should always be specified as UNC paths, as seen here. Avoid mapped or local drive references. Non-UNC paths may not be accessible to other users, machines or processes.
  3. Press the "Ok" button when finished.

Verify Repository Connection

  1. Press the "Save" button.
  2. Press the "List Repositories" button to view all repositories available to the CMIS Connection.
  3. Repositories will populate in the "Repository List" window.
    • If you do not see anything listed here, either:
      1. You have not successfully connected to the storage platform.
      2. There are no accessible repositories in the assigned location.

Import a Repository

  1. Select a repository in the "Repository List" window.
  2. Press the "Import Repository" button.

  1. This will add a CMIS Repository object as a child of the CMIS Connection object.
  2. You will also see the dot on the repository icon in the "Repository List" window change from red to green.

You can now use this repository for import and export operations. Grooper has full access to this folder location to bring in documents and export processed documents.

View the Repository

  1. Select the CMIS Repository object in the Node Tree.
  2. You can use the "Browse Repository" tab to view the documents and folders inside the imported CMIS Repository.
  3. If we double click the "Import" folder, we will open its contents, just like you would using the Windows File Explorer.
FYI All storage platforms can be browsed in this manner via their corresponding CMIS Binding, not just the NTFS binding.

  1. You can select documents in the repository as well.
  2. A preview of the document will populate in the "Document Viewer" window.

You could even copy one or more files and paste them directly into a test Batch if you like.

Furthermore, now that a connection is established, this CMIS Repository as a direct connection to the folder location.

If we are to add a folder in the Windows File System, the CMIS Repository will be aware of the change. You can even delete files, rename them, change editable properties, and cut/copy and paste items into folders, just like you can in the storage platform's native application. You have control of the repository as if you were using it natively.

  1. For example, we could right-click the blank space in the repository browser and select "Add Folder".
  2. This brings up a new window to name the new folder.
    • Which we've named "Disposed"
  3. If you press "Execute" a new folder will be created.

That means it creates it in the connected storage platform as well!

  1. In our case a windows folder named "Disposed" was created.

And the reverse would hold true as well, if we added a new folder (or new files) to the connected platform, Grooper would be aware of it via the CMIS Connection.

<tab name="Examining Type Definitions" style="margin:20px"> something something something

  1. While we're here, notice the "Content Types" window, listing File and Folder.
    • These objects allow Grooper to do more advanced operations such as metadata import and export mapping. The File object corresponds to documents and the Folder object corresponds to folders in the repository. They exist as child objects of the CMIS Connection.
  2. The associated metadata for the File and Folder objects are listed in the "Content Type Properties" window.
    • The available properties here will change depending on the CMIS Binding used. For example, the NTFS binding allows you to write filenames upon document export. Therefore, there is a writable "Name" property.

|


Version Differences

2.9 Box Integration

Grooper 2.9 sees the addition of the Box.com document storage platform into the CMIS fold via the Box (CMIS Binding).

2.72 Legacy Providers

Old import and export providers should be replaced with this new functionality. While Grooper's older import and export providers are available as "Legacy Import" and "Legacy Export" providers, these components are depreciated. They will still function but will no longer be upgraded in future versions of Grooper.

Grooper can import documents using CMIS Connections via "Import Descendants" and "Import Query Results". Grooper can export via the CMIS Export providers, Mapped Export and Unmapped Export.

2.72 New Connection Types

By creating the CMIS+ architecture, we have been able to create new connections between Grooper and content management systems.

Grooper can now connect to Microsoft OneDrive, SharePoint, and Exchange via new CMIS Bindings. Since these were created as CMIS Bindings, they can be used by the CMIS Import and CMIS Export providers. Instead of having to create three new import providers and three new export providers for a total of six brand new components, we can use the already established CMIS import and export providers in the CMIS+ framework. A user can create a CMIS Connection using the OneDrive, SharePoint or Exchange bindings, and use the same import and export providers for them as any of the other CMIS Bindings.

This will also allow Grooper to create CMIS Bindings to connect to currently unavailable content management systems in the future much quicker and easier.