Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Dell Validated Design for Manufacturing Edge - Design Guide with Litmus
Introduction Architecture System Design Accelerated Time to Value High Availability and Disaster Recovery Application Consolidation Cybersecurity Gateways Streaming Data Platform
Streaming Data Platform
Overall Streaming Data Platform
SDP core architecture
Deployment of SDP
SDP Grafana for database queries
Data ingest integration using Litmus to SDP
Analytics integration between Litmus and SDP
Pravega Python-based image ingest
Pravega search Python-based image retrieval
External data access from SDP
Summary
ISV Interoperability Sizing and Scaling Guidance Bill of Materials Additional Tasks Additional Information References

Data ingest integration using Litmus to SDP

Home > Edge > Manufacturing Edge > Guides > Dell Validated Design for Manufacturing Edge - Design Guide with Litmus > Data ingest integration using Litmus to SDP

Data ingest integration using Litmus to SDP

  • This DVD solution provides data publishing to a Litmus Edge instance for limited retention, and it can simultaneously use an SDP MQTT connector to publish the data from Ltimus Edge instances to SDP for long-term retention. Perform the following tasks to configure the data ingest.


    Edit Litmus Edge Hosts file

    This task is required for Litmus Edge to resolve the *.sdp.sdp-demo.org hostname that is used in the MQTT connector. This is required since this is the hostname tied to the default certificate generated on the SDP host.
    1. In Litmus Edge, select System > Network > DNS/NTP Servers.
    2. Select the plus sign, (+) to the right of Hosts file.
      Figure 75. Litmus hosts file update for SDP
      Litmus hosts file update for SDP
    3. Enter the <IP address> of the SDP ingress IP for the MQTT Broker (found in Kubeapps).
    4. Enter the hostname tied to the SDP MQTT Broker default certificate, pravega-mqtt-broker-<ProjectName>.sdp.<SDP Base Domain Name> .
    5. Click Create.
      Figure 76. Litmus Edge host binding for SDP
      Litmus Edge host binding for SDP

    Configure MQTT integrator on Litmus with stream name as the output topic

    1. From Litmus Edge, select Integration to configure MQTT integration for SDP connectivity.
    2. Select + and add a connector with MQTT Generic over SSL.
      Note: See the Security chapter regarding considerations for using HTTPS, SSL, TLS, and so on.

      Figure 77. Adding MQTT Generic over SSL provider on Litmus Edge
      Adding MQTT Generic over SSL provider on Litmus Edge
    3. Add or Edit a connector with SDP-specific MQTT broker information:
      1. Name—Descriptive name for the MQTT connector.
      2. Hostname—Certificate tied to hostname of sdp.sdp-demo.org.
      3. Port—8883.
      4. CA Certificate—Obtained from SDP by running Rundeck job SDP Information.
      5. Client ID—Create a unique ID.
      6. Username and Password—Created in deployment of MQTT Broker in Kubeapps in the YAML configuration file. This is obtained from Kubeapps by clicking the SDPToInfluxDBSink application.
      7. Integration topic—Topic to publish to on SDP MQTT Broker. This also automatically generates a steam with this name or it can be updated with an existing stream defined on SDP.

    Enable the integrator to publish data simultaneously to SDP

    1. Enable the integrator and ensure that it shows a Connected state.
    2. Click within the MQTT Connector box to add tags to send to SDP.
    The following figures show Litmus and SDP configured and showing data ingest to data providers on both applications.
    Note: The results shown in the figure are not tuned for performance and scale, as these tests were not run on a performance setup. They are provided here only as a reference.

    Figure 78. Litmus Edge dashboard with data ingest
    Litmus Edge dashboard with data ingest
    Figure 79. SDP snapshot with data ingest from Litmus using MQTT connector
    SDP snapshot with data ingest from Litmus using MQTT connector