Arxiv: https://lnkd.in/ew7X_5Gb Project: [Link not provided] 🔁 At a Glance 💡 Goal: Enable accurate, real-time robot localization by matching hierarchical scene graphs with prior architectural maps. ⚙️ Approach: - Graph Augmentation: Adds intra- and inter-level edges to encode spatial relations. - Shared MLP Encoder: Produces type-aware node embeddings for heterogeneous nodes. - Differentiable Matching: Uses affinity matrices and Sinkhorn algorithm for soft assignment. 📈 Impact (Key Results) 🧪 Accuracy and Speed: - Outperforms combinatorial baseline in F1 score on real LiDAR data. - Runs over 80× faster than previous methods. - Achieves high generalization zero-shot to real environments. 🔄 Scalability: - Handles partial/noisy observations. - Maintains real-time performance in complex environments. 🤖 Robustness: - Tolerates sensor noise and domain shift. 🔬 Experiments 🧪 Benchmarks: Synthetic MSD dataset, real LiDAR RE environment. 🎯 Tasks: Scene graph matching for localization. 🦾 Setup: Nvidia GPU, LiDAR sensor. 📐 Inputs: Architectural plans, LiDAR scans. 🛠 How to Implement 1️⃣ Construct hierarchical A-graphs and S-graphs. 2️⃣ Enrich graphs with relation edges. 3️⃣ Encode nodes via shared GATv2-based encoder. 4️⃣ Compute affinity matrix and normalize. 5️⃣ Apply Sinkhorn and Hungarian algorithms for matching. 📦 Deployment Benefits ✅ Fast, scalable real-time localization. ✅ Zero-shot generalization from synthetic to real data. ✅ Robust against observation noise. ✅ Compatible with existing BIM models. 📣 Takeaway This approach bridges semantic scene understanding with architectural prior maps, enabling more reliable and efficient indoor robot localization. Why it matters: It unlocks scalable, real-time semantic SLAM integrated with high-level structural priors. Follow me to know more about AI, ML and Robotics!
Real-Time Robot Localization with Scene Graph Matching
More Relevant Posts
-
[Denali: A Dataset Enabling Non-Line-of-Sight Spatial Reasoning with Low-Cost LiDARs] Arxiv: https://lnkd.in/etVD5Reu Project: [Link not provided] 🔁 At a Glance 💡 Goal: Demonstrate that low-cost consumer LiDARs can enable data-driven NLOS perception. ⚙️ Approach: - Dataset creation: Capture full time-resolved histograms from LiDARs. - Scene design: Elicit multi-bounce returns with hidden objects. - Data analysis: Evaluate perception tasks with various models. - Simulation pairing: Generate digital twins for model validation. 📈 Impact (Key Results) 🧪 NLOS tasks supported: - Localization RMSE of 0.046m. - Shape classification macro-F1 of 0.38. - Size prediction accuracy of 0.95. 🔄 Modeling challenges: - Scene size and position significantly influence perception. - Lighting impact complicates object disentanglement. 🤖 Application insights: - Digital twins help improve simulation fidelity. - Sensor design can be optimized based on task accuracy tolerances. 🔬 Experiments 🧪 Benchmarks: 72,000 scenes, 2.6 million pixels, 128 histogram bins 🎯 Tasks: Localization, classification, size prediction 🦾 Setup: Consumer LiDAR, RGB-D camera, motion tracking 📐 Inputs: Full LiDAR histograms to downstream tasks 🛠 How to Implement 1️⃣ Capture diverse scenes with low-cost LiDARs. 2️⃣ Label scene components with precise pose estimation. 3️⃣ Generate digital twins for simulation. 4️⃣ Train data-driven models on histogram inputs. 5️⃣ Test models for localization and classification. 📦 Deployment Benefits ✅ Enable NLOS perception with affordable hardware. ✅ Improve simulation for real-world deployment. ✅ Inform task-specific sensor design. ✅ Facilitate scalable and accessible NLOS solutions. 📣 Takeaway This work proves low-cost LiDARs hold rich multi-bounce signals valuable for NLOS vision. Data-driven approaches combined with simulation improve robustness. Achieving deployable NLOS perception moves from lab experiments to everyday devices. Follow me to know more about AI, ML and Robotics!
To view or add a comment, sign in
-
-
MCNav: Memory-Aware Dynamic Cognitive Map for Zero-shot Goal-oriented Navigation Arxiv: https://lnkd.in/e7fRvsrH 🔁 At a Glance 💡 Goal: Enable robust zero-shot goal-oriented navigation by leveraging dynamic memory and reasoning. ⚙️ Approach: - Cognitive Map: Stores relevant object info during exploration - Memory Strategies: Goal re-validation & missed goal re-exploration - Mechanisms: Blacklist & double-check for robustness 📈 Impact (Key Results) 🧪 State-of-the-art success rates on HM3Dv1 & HM3Dv2 datasets - Outperforms existing methods in instance-level, object, and text goals - Specifically boosts SR and SPL in complex scene navigation 🔄 Enhanced robustness and efficiency through memory-guided revisits 🤖 Incorporates LLM/VLM reasoning for dynamic scene understanding 🔬 Experiments 🧪 Benchmarks: HM3Dv1 & HM3Dv2 datasets 🎯 Tasks: Object goal, instance image, text goal navigation 🦾 Setup: Habitat simulator, NVIDIA RTX 4090, RGB-D sensors 📐 Inputs: RGB-D images, textual descriptions, object detections 🛠 How to Implement 1️⃣ Build base frontier-based exploration with semantic maps 2️⃣ Extend with sparse cognitive map updating with object detections 3️⃣ Apply goal re-validation & missed goal re-exploration strategies guided by VLM 4️⃣ Use blacklist to avoid repeated failures & double-check for goal verification 5️⃣ Use algorithm pipeline for iterative navigation until goal is reached 📦 Deployment Benefits ✅ Improves success rates in complex environments ✅ Adds memory and reasoning for better exploration ✅ Reduces false positives via double check ✅ Enhances zero-shot generalization without training 📣 Takeaway Integrating a dynamic cognitive memory with multimodal reasoning marks a shift towards more intelligent, autonomous navigation. This approach enables agents to revisit, re-validate, and reason with scene memory, improving reliability. With such systems, robots will better handle real-world complexities and unseen environments. Follow me to know more about AI, ML and Robotics!
To view or add a comment, sign in
-
-
Depth estimation is one of the most important perception capabilities in modern computer vision systems. But the industry is still divided between two fundamentally different approaches: • Monocular depth estimation vs • Stereo depth estimation At a high level, both attempt to reconstruct 3D spatial understanding from visual input — but the engineering tradeoffs are entirely different. Stereo depth estimation relies on geometric correspondence between two synchronized cameras. By analyzing pixel displacement between left and right views, the system can infer scene depth with strong geometric consistency. This makes stereo systems highly effective for: • Robotics • Autonomous navigation • Industrial automation • Warehouse systems • AR/VR spatial tracking The advantage is physical depth grounding. The challenge is operational complexity. Stereo pipelines require: • Precise camera calibration • Baseline optimization • Synchronization stability • Occlusion handling • Dense correspondence matching • High-quality rectification pipelines Performance can degrade rapidly under: • Low-texture environments • Reflective surfaces • Repetitive patterns • Poor lighting conditions Monocular depth estimation approaches the problem differently. Instead of triangulation, the model learns spatial priors directly from massive datasets using deep neural architectures. The system predicts relative scene geometry from a single image by learning: • Object scale relationships • Perspective cues • Semantic context • Surface continuity • Scene structure priors Modern monocular systems increasingly leverage: • Vision transformers • Self-supervised learning • Multi-scale feature fusion • Temporal consistency modeling • Foundation-model-based scene understanding The operational advantage is significant. Monocular systems require: • Only one camera • Lower hardware cost • Simpler deployment • Easier edge integration • Reduced calibration overhead But they introduce a different challenge: Depth becomes probabilistic rather than physically constrained. This creates limitations in: • Absolute metric accuracy • Long-range precision • Edge-case generalization • Safety-critical autonomy In practice, the decision is rarely about “which is better.” It is about selecting the correct perception architecture for the operational environment. Stereo depth provides stronger geometric reliability. Monocular depth provides scalability and deployment flexibility. The future of perception systems will likely combine both: geometry-driven sensing + learned spatial reasoning. Because true machine perception is not just about seeing objects. It is about understanding space. #ComputerVision #ArtificialIntelligence #DepthEstimation #MonocularDepth #StereoVision #MachineLearning #DeepLearning #AutonomousSystems #Robotics #3DVision #EdgeAI #AIInnovation
To view or add a comment, sign in
-
-
NeuroDepth — Multi-Model Perception Pipeline (Neuromorphic + Detection + Depth + VLM) Built an end-to-end perception system that fuses motion, geometry, detection, and language into a single pipeline — benchmarked on T4 and deployed locally on M1 (MPS). The system integrates: 🧠 Neuromorphic-style motion encoding (event-based representation) 📦 Transformer-based object detection (RF-DETR family) 📏 Monocular metric depth estimation (no stereo / LiDAR) 🔍 Vision-language reasoning on selected regions Core idea: Use motion as an attention prior to guide expensive inference → improves efficiency without sacrificing semantic understanding. 📊 Benchmarks (Google Colab T4) Detection: ~80–100 ms / frame Depth (pre-optimization): ~6.2 s Depth (optimized): ~1.5 s (~3–4× speedup) VLM inference: ~1.3 – 3.8 s End-to-end pipeline: ~3 – 8 s / frame (scene-dependent) Optimization of the depth module alone significantly reduced total pipeline latency. 🧪 Output Per-frame fused perception: Object detections + confidence Absolute depth (meters) Context-aware natural language descriptions ⚙️ System Design Parallel multi-branch architecture → fused into a unified output layer Compute-aware routing reduces unnecessary multimodal inference Optimized to run locally on Apple Silicon within tight memory limits Code coming soon. #ComputerVision #DeepLearning #Multimodal #EdgeAI #AI #Robotics
To view or add a comment, sign in
-
-
GenAssets: Generating in-the-wild 3D Assets in Latent Space Arxiv: https://lnkd.in/eSDfeRXt 🔁 At a Glance 💡 Goal: Develop a scalable method to generate high-quality 3D assets from in-the-wild sensor data for traffic simulation. ⚙️ Approach: - Reconstruct-then-generate: Build complete 3D assets via neural rendering and latent diffusion. - Occlusion-aware neural rendering: Handle partial observations and occlusions. - Latent space learning: Compress scene and actor info for scalable generation. - Diffusion model training: Enable diverse, controllable asset creation. 📈 Impact (Key Results) 🧪 Reconstruction: - Outperforms state-of-the-art on sparse, novel, and 360° views. - More accurate and complete in diverse scenarios. 🔄 Generation: - Better visual quality with lower FID/KID scores. - Supports conditioning on class, time, and sparse sensor input. 🤖 Applications: - Single-image 3D reconstruction. - Data augmentation improves detection accuracy. 🔬 Experiments 🧪 Benchmarks: PandaSet dataset. 🎯 Tasks: 3D reconstruction, novel view synthesis, conditional generation. 🦾 Setup: 6 cameras, 360° LiDAR, real-world scenes. 📐 Inputs: Camera images, LiDAR point clouds, actor masks. 🛠 How to Implement 1️⃣ Collect in-the-wild LiDAR & camera data. 2️⃣ Train neural scene representation with occlusion awareness. 3️⃣ Encode actors into latent space. 4️⃣ Train diffusion model on latent codes. 5️⃣ Generate and render assets conditioned on various inputs. 📦 Deployment Benefits ✅ High-quality and diverse 3D assets. ✅ Robust to partial occlusions & sparse views. ✅ Supports conditional and single-image generation. ✅ Enhances simulation realism and scalability. 📣 Takeaway This method pushes the boundary of real-world 3D asset generation from sensor data. Enabling safer, more realistic autonomous vehicle simulations. Its scalability and controllability open new avenues in AI-driven simulation content. Follow me to know more about AI, ML and Robotics!
To view or add a comment, sign in
-
-
Diffusion-guided Generalizable Enhancer for Urban Scene Reconstruction: A new method leveraging diffusion models to improve urban scene reconstruction across large viewpoint shifts. Arxiv: https://lnkd.in/ek78Yvmf Project: [Link not provided] 🔁 At a Glance 💡 Goal: Enable robust, high-fidelity urban scene reconstructions that generalize under challenging viewpoints. ⚙️ Approach: One-step diffusion neural fixer: Corrects artifacts in novel views. 3D enhancer: Updates Gaussian parameters for multi-view consistency. Training across diverse scenes: Learns to transfer priors for robustness. 📈 Impact (Key Results) 🧪 Improved quality and efficiency over state-of-the-art methods. Enhances downstream tasks like sensor simulation, perception testing, and object detection. 🔄 Generalizes well to unseen viewpoints, handling lane changes & large shifts. 🤖 Produces stable, realistic renderings across diverse urban scenes. 🔬 Experiments 🧪 Benchmarks: PandaSet, various urban scene datasets. 🎯 Tasks: Reconstruction, view extrapolation, simulation, perception. 🦾 Setup: GPU training, iterative refinement, real-world sensory data. 📐 Inputs: Camera images, LiDAR, multi-view observations. 🛠 How to Implement 1️⃣ Obtain initial 3D Gaussian scene with existing methods. 2️⃣ Render at new viewpoints, fix artifacts via FNet. 3️⃣ Refine Gaussian parameters with ENet. 4️⃣ Integrate into the GenRe pipeline. 5️⃣ Fine-tune or apply zero-shot to new scenes. 📦 Deployment Benefits ✅ Fast scene fixes in minutes. ✅ Robust, scalable urban scene modeling. ✅ Supports diverse downstream applications. ✅ Improves view consistency and realism. 📣 Takeaway GenRe brings unmatched efficiency and robustness to urban scene reconstruction. By combining diffusion-guided fixing and enhancement, it paves the way for real-time, scalable simulation. This is a significant step toward reliable autonomous driving testing and perception evaluation. Follow me to know more about AI, ML and Robotics!
To view or add a comment, sign in
-
-
New Post: Graph-Based Deep Learning for Fine‑Grained Part Segmentation of ShapeNet Automobile Models from Partial Point Clouds - ## Abstract Fine‑grained semantic segmentation of automotive 3‑D models underpins downstream tasks such as virtual prototyping, collision simulation, and digital‑twin generation. Existing pipelines evaluated on ShapeNet typically assume complete, noise‑free point clouds, an assumption that rarely holds for real‑world LiDAR or photogrammetry scans, which are often occluded or sparse. In this synthetic exploratory study we \[…\] \[Source & Legal Disclaimer\] This is an AI-generated simulation research dataset provided by Freederia.com, released under the Apache 2.0 License. Users may freely modify and commercially use this data \(including patenting novel improvements\); however, obtaining exclusive patent rights on the original raw data itself is prohibited. As this is AI-simulated data, users are strictly responsible for independently verifying existing copyrights and patents before use. The provider assumes no legal liability. For future Enterprise API access and bulk dataset purchase inquiries, please contact Freederia.com.
To view or add a comment, sign in
-
Vision Guidence System for an Interceptor: How a 2-pixel error becomes a 50-meter miss. At SpearX, we talks about "replacing radar with vision." But in reality, Vision-based guidance isn't just about swapping sensors. It is a complex "dance" between the algorithm and the physics of flight. When I look at our architecture, the camera isn't just a passive sensor. It is the heartbeat of the control loop. How do we make "camera → steering command" work reliably? 🔹 The Eyes: Geometry over Pixels A camera gives us coordinates, not truth. Lenses distort; vibrations shake the horizon. Our job at #SpearX is to teach the CUAS system to understand real space. We filter the noise so every pixel matches a real direction. 🔹 Time is the Enemy The chain "Capture → Process → Act" takes time. While the AI thinks, a fast target moves. If we miss 2 frames, we are chasing the past. We don't just detect; we predict where the target will be when our actuators finally move. 🔹 Scale Matters A 1-pixel shift is small on a screen but huge in the sky. We use optical flow logic: if the target stays in one spot in the frame, our paths will cross. But cameras measure angles, while engines control linear motion. The math must bridge this gap. 🔹 Trusting the Data Real-world data is noisy. We use smart filters to smooth the signal. But here is the key: our algorithms estimate confidence. If the vision is blurry or unsure, the controller becomes cautious. It doesn't guess; it manages risk. How we integrate Vision and Dynamics at SpearX: 1.Remove Self-Motion: We subtract the drone's own movement to see the target's true path. 2.Predictive Control: We sync our clocks tightly. We aim for where the target will be, not where it is. 3️.Shared Uncertainty: The vision module tells the flight computer: "I see it, but I'm only 85% sure." The flight computer listens and adjusts. My opinions: In autonomous systems, there is no "just an image." A tiny pixel error, multiplied by speed and delay, causes a real miss. That is why we believe in co-Design. We train vision with flight physics in mind, and we build flight controls that understand vision errors. We build honest systems that tell us not just where the target is, but how sure they are. Question from me: What is your biggest challenge when fast software meets hard physics? Let's discuss below. #VisionBasedGuidance #CTO #ComputerVision #GuidanceSystems #UAV #AutonomousSystems #SystemsEngineering #AI #ControlSystems #Robotics #SpearX #DefenseIndustry #EdgeAI #CV #Seekers #UAV #DefenseTech #ML #Interceptor #CUAS
To view or add a comment, sign in
-
-
Rule-VLN: Bridging Perception and Compliance via Semantic Reasoning and Geometric Rectification Arxiv: https://lnkd.in/eizHCJzz Project: [Link not provided] 🔁 At a Glance 💡 Goal: Address the gap in VLN where agents overlook semantic, rule-based constraints in urban environments. ⚙️ Approach: Semantic Navigation Rectification Module (SNRM): equips agents with safety awareness Dynamic graph modification & semantic injection: injects regulatory constraints into navigation environment Epistemic mental map: for dynamic detour planning and rule compliance Macro-micro visual prompting: enhances visual perception of rules Knowledge-driven rule grounding: links visual cues to semantic rules 📈 Impact (Key Results) 🧪 Safety & Compliance: Reduces Constraint Violation Rate (CVR) by 19.26% with SNRM Boosts Task Completion (TC) by 5.97% 🔄 Performance: Significantly challenges state-of-the-art algorithms, showing their limitations in rule-based navigation SNRM restores navigation capabilities in complex, constrained environments 🤖 Safety & Robustness: SNRM improves robustness across diverse architectures, maintaining high TC and low CVR even at high constraint levels 🔬 Experiments 🧪 Benchmarks: Rule-VLN, CityNav-Rules-73K 🎯 Tasks: Urban rule-compliant navigation 🦾 Setup: Real-world urban environments, various VLN models, NVIDIA GPUs 📐 Inputs: Panoramic visual observations & natural language instructions 🛠 How to Implement 1️⃣ Construct environment with semantic constraints via CityNav-Rules-73K 2️⃣ Inject semantic signs into panoramas using MPSI pipeline 3️⃣ Integrate SNRM with existing VLN agents, leveraging macro-micro perception and mental map 4️⃣ Train or deploy models, evaluate on CVR and TC metrics 5️⃣ Fine-tune and iterate for specific urban scenarios 📦 Deployment Benefits ✅ Ensures safety through strict rule adherence ✅ Improves navigation in complex environments ✅ Enables zero-shot, model-agnostic rule compliance ✅ Bridges perception and semantic reasoning for embodied AI 📣 Takeaway Current VLN models fall short in socially compliant, rule-aware navigation. Rule-VLN creates a realistic benchmark for safety-critical tasks. SNRM provides an effective, training-free solution to enhance safety and compliance. This work paves the way for truly autonomous, socially aware embodied agents. Follow me to know more about AI, ML and Robotics!
To view or add a comment, sign in
-
-
𝐏𝐈𝐑𝐋 (2): 𝐇𝐨𝐰 𝐝𝐨 𝐰𝐞 𝐠𝐢𝐯𝐞 𝐑𝐋 𝐚𝐠𝐞𝐧𝐭𝐬 𝐚𝐧 𝐮𝐧𝐝𝐞𝐫𝐬𝐭𝐚𝐧𝐝𝐢𝐧𝐠 𝐨𝐟 𝐩𝐡𝐲𝐬𝐢𝐜𝐬? 🤖 → 🧑🎓 As reinforcement learning moves into robotics and autonomous systems, one key challenge stands out: how do we make agents respect the laws of the physical world? 𝐏𝐡𝐲𝐬𝐢𝐜𝐬-𝐈𝐧𝐟𝐨𝐫𝐦𝐞𝐝 𝐑𝐞𝐢𝐧𝐟𝐨𝐫𝐜𝐞𝐦𝐞𝐧𝐭 𝐋𝐞𝐚𝐫𝐧𝐢𝐧𝐠 (𝐏𝐈𝐑𝐋) tackles this through three core strategies 👇 🔵 𝐎𝐛𝐬𝐞𝐫𝐯𝐚𝐭𝐢𝐨𝐧𝐚𝐥 𝐁𝐢𝐚𝐬 Train on physics-rich data from simulations or physical equations. > 🚁 𝘈 𝘥𝘳𝘰𝘯𝘦 𝘵𝘳𝘢𝘪𝘯𝘦𝘥 𝘰𝘯 𝘢𝘦𝘳𝘰𝘥𝘺𝘯𝘢𝘮𝘪𝘤 𝘴𝘪𝘮𝘶𝘭𝘢𝘵𝘪𝘰𝘯 𝘥𝘢𝘵𝘢 𝘭𝘦𝘢𝘳𝘯𝘴 𝘵𝘰 𝘢𝘯𝘵𝘪𝘤𝘪𝘱𝘢𝘵𝘦 𝘢𝘪𝘳𝘧𝘭𝘰𝘸 𝘥𝘪𝘴𝘵𝘶𝘳𝘣𝘢𝘯𝘤𝘦𝘴 𝘣𝘦𝘧𝘰𝘳𝘦 𝘪𝘵𝘴 𝘧𝘪𝘳𝘴𝘵 𝘳𝘦𝘢𝘭 𝘧𝘭𝘪𝘨𝘩𝘵. 🟡 𝐋𝐞𝐚𝐫𝐧𝐢𝐧𝐠 𝐁𝐢𝐚𝐬 Penalize physics violations directly in the loss function using PINNs or physics-based regularizers. > 🦾 𝘈 𝘳𝘰𝘣𝘰𝘵𝘪𝘤 𝘢𝘳𝘮 𝘱𝘦𝘯𝘢𝘭𝘪𝘻𝘦𝘥 𝘧𝘰𝘳 𝘵𝘰𝘳𝘲𝘶𝘦 𝘴𝘦𝘲𝘶𝘦𝘯𝘤𝘦𝘴 𝘵𝘩𝘢𝘵 𝘷𝘪𝘰𝘭𝘢𝘵𝘦 𝘕𝘦𝘸𝘵𝘰𝘯'𝘴 𝘭𝘢𝘸𝘴 𝘤𝘰𝘯𝘷𝘦𝘳𝘨𝘦𝘴 𝘧𝘢𝘴𝘵𝘦𝘳 𝘢𝘯𝘥 𝘮𝘰𝘷𝘦𝘴 𝘮𝘰𝘳𝘦 𝘦𝘧𝘧𝘪𝘤𝘪𝘦𝘯𝘵𝘭𝘺. 🔴 𝐈𝐧𝐝𝐮𝐜𝐭𝐢𝐯𝐞 𝐁𝐢𝐚𝐬 Hard-wire physics into the network architecture itself using Hamiltonian or Lagrangian Neural Networks. > 🐕 𝘈 𝘭𝘦𝘨𝘨𝘦𝘥 𝘳𝘰𝘣𝘰𝘵 𝘴𝘵𝘳𝘶𝘤𝘵𝘶𝘳𝘢𝘭𝘭𝘺 𝘤𝘰𝘯𝘴𝘵𝘳𝘢𝘪𝘯𝘦𝘥 𝘵𝘰 𝘤𝘰𝘯𝘴𝘦𝘳𝘷𝘦 𝘦𝘯𝘦𝘳𝘨𝘺 𝘯𝘢𝘵𝘶𝘳𝘢𝘭𝘭𝘺 𝘭𝘦𝘢𝘳𝘯𝘴 𝘴𝘮𝘰𝘰𝘵𝘩𝘦𝘳, 𝘮𝘰𝘳𝘦 𝘦𝘧𝘧𝘪𝘤𝘪𝘦𝘯𝘵 𝘨𝘢𝘪𝘵𝘴. Physics can also be injected at specific stages of the RL pipeline ⚙️ 🎯 𝐑𝐞𝐰𝐚𝐫𝐝 𝐝𝐞𝐬𝐢𝐠𝐧: A drone rewarded for maintaining aerodynamically stable orientations, not just reaching a target 🛡️ 𝐀𝐜𝐭𝐢𝐨𝐧 𝐫𝐞𝐠𝐮𝐥𝐚𝐭𝐢𝐨𝐧: Control Barrier Functions preventing a robot arm from commanding joint velocities that would cause mechanical damage 📡 𝐒𝐭𝐚𝐭𝐞 𝐝𝐞𝐬𝐢𝐠𝐧: Feeding a drone its IMU-derived inertial state alongside raw sensor data for physically grounded perception 🌐 𝐌𝐨𝐝𝐞𝐥 𝐚𝐮𝐠𝐦𝐞𝐧𝐭𝐚𝐭𝐢𝐨𝐧: A digital twin of a quadruped used to pre-train policies safely before real-world deployment 📊 𝑼𝒑 𝒏𝒆𝒙𝒕: 𝘞𝘦'𝘭𝘭 𝘱𝘶𝘵 𝘵𝘩𝘦𝘴𝘦 𝘪𝘥𝘦𝘢𝘴 𝘵𝘰 𝘵𝘩𝘦 𝘵𝘦𝘴𝘵, 𝘤𝘰𝘮𝘱𝘢𝘳𝘪𝘯𝘨 𝘴𝘵𝘢𝘯𝘥𝘢𝘳𝘥 𝘙𝘓 𝘢𝘭𝘨𝘰𝘳𝘪𝘵𝘩𝘮𝘴 𝘩𝘦𝘢𝘥-𝘵𝘰-𝘩𝘦𝘢𝘥 𝘸𝘪𝘵𝘩 𝘵𝘩𝘦𝘪𝘳 𝘗𝘐𝘙𝘓 𝘤𝘰𝘶𝘯𝘵𝘦𝘳𝘱𝘢𝘳𝘵𝘴 𝘵𝘰 𝘴𝘦𝘦 𝘸𝘩𝘦𝘳𝘦 𝘱𝘩𝘺𝘴𝘪𝘤𝘴 𝘬𝘯𝘰𝘸𝘭𝘦𝘥𝘨𝘦 𝘳𝘦𝘢𝘭𝘭𝘺 𝘮𝘢𝘬𝘦𝘴 𝘢 𝘥𝘪𝘧𝘧𝘦𝘳𝘦𝘯𝘤𝘦. --- 📘 Part 2 of my Physics-Informed Reinforcement Learning (PIRL) series In this series, I explore PIRL from an optimal control perspective, with applications to aerospace systems, robotic manipulators, and aerial manipulators. #ReinforcementLearning #PhysicsInformed #Robotics #ControlSystems #EfficientLearning
To view or add a comment, sign in
-