Weld Porosity Detection#
Prevent defects in real time with AI-powered monitoring.
Overview#
AI and machine vision enable real-time detection of welding defects, ensuring immediate corrective action before issues escalate. By leveraging the right camera and computing hardware, a trained AI model continuously monitors the weld, halting the process the moment a defect is detected. Deep learning AI processes video data at frame rates far beyond human capability, delivering unmatched precision and reliability.
How It Works#
This sample application consists of the following microservices: DL Streamer Pipeline Server, Model Registry Microservice(MRaaS), MediaMTX server, Coturn server, Open Telemetry Collector, Prometheus, Postgres and Minio.
You start the weld porosity classification pipeline with a REST request using Client URL (cURL). The REST request will return a pipeline instance ID. DL Streamer Pipeline Server then sends the images with overlaid bounding boxes through webrtc protocol to webrtc browser client. This is done via the MediaMTX server used for signalling. Coturn server is used to facilitate NAT traversal and ensure that the webrtc stream is accessible on a non-native browser client and helps in cases where firewall is enabled. DL Streamer Pipeline Server also sends the images to S3 compliant storage. The Open Telemetry Data exported by DL Streamer Pipeline Server to Open Telemetry Collector is scraped by Prometheus and can be seen on Prometheus UI. Any desired AI model from the Model Registry Microservice (which can interact with Postgres, Minio and Geti Server for getting the model) can be pulled into DL Streamer Pipeline Server and used for inference in the sample application.
Figure 1: Architecture diagram
This sample application is built with the following Intel Edge AI Stack Microservices:
DL Streamer Pipeline Server is an interoperable containerized microservice based on Python for video ingestion and deep learning inferencing functions.
Model Registry Microservice provides a centralized repository that facilitates the management of AI models
It also consists of the below Third-party microservices:
MediaMTX Server is a real-time media server and media proxy that allows to publish webrtc stream.
Coturn Server is a media traffic NAT traversal server and gateway.
Open telemetry Collector is a set of receivers, exporters, processors, connectors for Open Telemetry.
Prometheus is a systems and service monitoring system used for viewing Open Telemetry.
Postgres is object-relational database system that provides reliability and data integrity.
Minio is high performance object storage that is API compatible with Amazon S3 cloud storage service.
Features#
This sample application offers the following features:
High-speed data exchange with low-latency compute.
Real-time AI-assisted classification of defects during the welding process.
On-premise data processing for data privacy and efficient use of bandwidth.
Interconnected welding setups deliver analytics for quick and informed tracking and decision making.