Connectors
In the connectors section, a user can create connection configs for various data sources which could be Streaming, SQL, NoSQL, Caching, etc. A connection config in itself is known as a Connector. We can create connectors for applications (data sources) that are available from the marketplace and for users' privately hosted data sources as well. Once a connector is created then it can be used at various places in the LINC CONNECT platform such as in the ETL pipeline, ML experiments, etc.
Let's create a Connector for the MongoDB instance which we recently created using Marketplace (discussed in the Market section). Click on MongoDB available on the connectors page and click on Add New, enter the details - name, description, connector type (source/sink), select an instance from the marketplace dropdown, select database & user, test the connection, and click on Save.
We have created a MongoDB Sink Connector which can be used to write data using various LINC CONNECT services OR by external application if the MongoDB instance is publicly exposed. Similarly, you can create another connector that can be used to read data from the same MongoDB instance, just select the connector type as a source while creating the connector.
Similarly, you can create connectors for other services also, either they are created using Marketplace or they are privately hosted (select the connection type as external while creating connector -- this functionality is to be added soon).
Last updated