Thermal imaging
News
Hanwha Vision, the global vision solution provider, has unveiled its new high-performance bi-spectrum radiometric thermal AI cameras, which are ideal for use in perimeter protection, traffic monitoring, manufacturing, industrial facilities, data centres, solar farms, and more. TNM-C3620TDR/C3622TDR cameras The TNM-C3620TDR/C3622TDR cameras serve as compact indoor models and feature QVGA resolution on the thermal lens and 2MP on the visible sensor, while the TNM-C4940TDR/C4942TDR outdoor models combine advanced VGA thermal and 4K video. The range is designed to deliver clear images in all lighting scenarios, with AI-powered analytics for accurate object detection, and temperature monitoring between -20°C and 130°C. AI for greater accuracy With the outdoor models supporting AI on thermal and visible sensors, they can detect objects in difficult lighting With the outdoor models supporting AI on thermal and visible sensors, they can not only detect objects in difficult lighting conditions, such as complete darkness, fog, or rain, but also alert operators to potential intrusion, loitering, or other suspicious behaviours. Meanwhile, the compact indoor models feature AI on the visible channel. Operational efficiency By ensuring a high degree of accuracy across the range, false alarms triggered by irrelevant motion, for example, wildlife or shadows, are significantly reduced, improving operational efficiency and meaning operators focus only on genuine events. Intelligent video analytics also include enter/exit monitoring and virtual line-crossing detection. Precise temperature monitoring The bi-spectrum radiometric thermal AI cameras offer precise temperature measurements between -20°C and 130°C, making them ideal for industrial applications. By providing critical data on temperature changes, the cameras can alert operators to potential issues such as overheating parts or equipment failure, minimising downtime, enabling proactive maintenance, and enhancing operational efficiency and safety. Operators can toggle between eight colour palettes on the thermal channel, to easily review any temperature changes and enhance the visibility of a scene. Perimeter protection and traffic management The cameras can also be used for traffic monitoring, alerting to stopped traffic that may signal a road accident In particular, the outdoor models are well suited to perimeter protection and can alert operators to potential boundary breaches. The thermal lens can identify potential perimeter breaches across sites by detecting body heat signatures, while the visual lens identifies and classifies objects. The cameras can also be used for traffic monitoring, alerting to stopped traffic that may signal a road accident or congestion. The cameras enable a high degree of accuracy and fewer false alarms. Flexible options The TNM-C3622TDR (indoor model) and TNM-C4942TDR (outdoor model) operate at 8fps on the thermal sensor and therefore are excluded from the Wassenaar Arrangement, an export control regime that governs sensitive goods including cameras with frame rates over 9fps. This makes exporting and importing them simpler and, as such, results in shorter lead times.
3xLOGIC, the pioneering innovator in security and business intelligence, has launched four new camera and imager solutions providing exceptional high-definition quality and intelligent software to improve business insights. Each camera offers unique features tailored to business needs. Some include fixed lens capabilities, AI analytics, enhanced visual performance for poor lighting conditions, and more. VISIX™ Dual Thermal Imager VISIX™ Dual Thermal/Visible Light Imager combines visible light and thermal imaging with edge-based deep learning analytics for enhanced security and real-time monitoring, revolutionising surveillance for improved efficiency and effectiveness. This Dual Imager integrates a 5MP, 4mm visible light sensor with a 56-degree field of view, and a 320x240 resolution thermal imager in a single housing. Perfect solution for day or night surveillance and threat detection in retail, education, commercial Perfect solution for day or night surveillance and threat detection in retail, education, commercial, and warehousing. It can also support temperature detection for applications such as food manufacturing, oil and gas, mining, and chemical manufacturing where tight temperature control is required. Alerts will be generated when a temperature goes higher or lower than the set threshold, or when a temperature is raised or lowered at a defined ratio and interval. This helps operators reduce the risk of fire, explosion, and food spoiling. VISIX™ 5MP Ball Turret Camera Series The cameras are easy to install, with optimal 70’ IR and perimeter coverage VISIX™ 5MP Ball Turret Camera Series features highly adjustable, easy-to-install, high-definition cameras in housing preferred for use cases where optimal infrared coverage and clarity are required in challenging lighting conditions. This camera is well suited for perimeter surveillance of storefronts, parking lots, and inventory areas ensuring precise threat detection day and night. This cost-effective solution is flexible and versatile for indoor or outdoor use, providing clarity in otherwise poor visibility areas. The cameras are easy to install, with optimal 70’ IR and perimeter coverage, True Wide Dynamic Range (WDR), and Fixed or Varifocal Lenses. VISIX™ 10MP Fixed Dual Imager VISIX™ 10MP Fixed Dual Imager offers high-definition coverage with the ability to manually adjust two 5MP lenses in one housing unit. This allows for dual use of the imagers, including using one for edge-based AI video analytics to accurately detect and track people, objects, and vehicles — making it well suited for installations in small spaces where the imager can offer full coverage, for instance: dual entrances, turnstiles, and hallways. The camera comes with vandal-proof housing, WDR to provide clear images in challenging lighting, and IR of 60’ each lens (120’ total). VISIX™ 20MP Varifocal Surround Camera End-users gain the use of four separate images in a single housing with the power to pan, tilt, and zoom VISIX™ 20MP Varifocal Surround Camera has four independent imagers capable of manual adjustment that can be positioned to cover virtually any security footprint. End-users gain the benefit of four separate images in a single housing with the ability to pan, tilt, and zoom each sensor individually. It comes with Audio and Alarm capabilities, remote zoom, WDR, and IR up to 100’. The camera is designed for large areas where full video coverage is needed such as large commercial spaces, warehouses, data centres, and car parks. The Dual Thermal/Visible Light Imager, Fixed Dual Imager, and Surround models come with edge-based analytics that carry out object detection and tracking within the devices themselves with insights and metadata transmitted back to operators. This reduces the need for costly server rooms, making deep learning analytics more accessible for a range of applications. Based on deep learning, false alarms from wildlife, moving trees and wind, are reduced. Advanced AI video analytics Mike Poe, Director of Product Management at 3xLOGIC, says: “With the latest camera models, 3xLOGIC is expanding the options available to the market for affordable and easy-to-install devices that carry out vital AI analytics at the edge. This makes advanced AI video analytics accessible to many different applications with no need for expensive server rooms, additional cabling, and extra ongoing maintenance.” “The dual-image cameras take this cost efficiency even further by combining two imagers in one device, making it simple for end-users to benefit from two lenses in the same housing without multiple devices and installations needed.”
Hikvision, a world-renowned manufacturer and supplier of security products and solutions that deliver the ideal combination of high performance and extreme value, is excited to announce the rollout of its Phase 1 Kiosk Program across 28 locations in the U.S. This initiative includes live product demos at participating distributors, designed to offer customers a hands-on experience with the latest Hikvision technologies and equipment. Range of Hikvision products "The Hikvision Kiosk Program is a customer-facing live demo which allows customers to walk into a Hikvision Experience Centre to get hands-on experience or training with the latest and greatest Hikvision technologies and equipment," said John Xiao, Vice President of Marketing, Hikvision USA, adding, "This initiative will drive engagement, enabling customers to explore and interact with our innovative solutions firsthand." Kiosk users will have the chance to study and interact with a range of Hikvision products Each kiosk will feature the HikCentral Workstation, which serves as the central hub for demonstrating Hikvision's advanced features to customers. Kiosk users will have the opportunity to explore and interact with a range of Hikvision products on the HikCentral Workstation, including: 8K M-Series NVRs: Ultra high-definition recording and playback capabilities. ColorVu Technology: Enhanced low-light performance cameras for full-colour 24/7. TandemVu Cameras: Dual-lens technology and smart linkage auto-tracking with a bullet and PTZ in one unit for broader surveillance coverage. Thermal Cameras: Advanced HeatPro thermal imaging for deep learning analytics, seeing the invisible along perimeters, and early fire detection. Stealth Edition Black Housing Cameras: Style meets functionality in our portfolio of black housing cameras. Touch Screen Facial Authentication Intercom: Next-generation, touchless access control using facial authentication or other biometrics. Vandal-Proof Intercom: Durable and robust access control for urban environments.
Following the delivery of the first batch in 2023, solution specialist HENSOLDT is equipping the German Armed Forces with 90 additional Spotter 42. The enhanced Spotter complements HENSOLDT's Spotter 60, which is already in use in the troops, and replaces a predecessor model. Spotter 42 Compared to the Spotter 60, the magnification range of the Spotter 42 starts at six times instead of twenty times. The Spotter 42 is therefore optimised for use with night vision and thermal imaging attachments (NSV and IRV). The result is a significant improvement in observation capability in restricted visibility conditions. Optical performance “The optical performance of the Spotter 42 is outstanding. It represents a milestone in the compact observation optics device category with its large field of view, high edge-to-edge sharpness, and brilliant image quality across the entire magnification range of 6-42x,” explained the responsible Sales Manager Josef Reif. The observation optics have become more compact thanks to a modified optical concept. The result is a high magnification range with low initial magnification while simultaneously reducing the weight. Bundeswehr specifications and features Additional mounting rails on the device enable the attachment of various additional devices The Spotter 42 complies with Bundeswehr specifications and features steplessly adjustable reticle illumination as well as an integrated laser filter that compensates for the magnification-related increase in the radiance of harmful laser radiation without noticeably impairing the visual transmission values. The accessories include a long mounting rail with a Picatinny profile on both sides, allowing attachments of different heights to be used. Additional mounting rails on the device enable the attachment of various additional devices such as target pointers or rangefinders. Increased visibility “The initial feedback from users has been more than positive,” added Josef Reif. The Spotter 42 enhances the night combat capability of snipers by increasing their ability to observe in restricted visibility, thus making an important contribution to increasing the combat readiness of the German armed forces. The Spotter 42 was very well received by users and procurers from the military authorities of European nations at EnforceTac 2024 in Nuremberg and will be offered as a series device. In a further expansion stage, it will receive additional functional additions in the future that will expand its area of use.
Expert commentary
There’s a new security paradigm emerging across malls, server farms, smart office buildings, and warehouses, and its advantage over the status quo are so broad they are impossible to ignore. Instead of a lecture, let’s start with a short narrative scenario to illustrate my point. Darryl's work Darryl works as a security guard at the Eastwood Mall. Like any typical evening, tonight’s shift begins at 9:30 PM, as the stores close and the crowds thin. His first task: Ensure that by 10 pm, all mall visitors have actually left and that all doors, windows, and docks are locked securely. As he walks through most major areas throughout the mall, he checks them off his list. All’s quiet, so after a 45-minute patrol, he stops for a quick coffee break before heading out again. He repeats the process throughout the night, happy to finish each round’s checklist and rest his feet for a few minutes. Challenge: Vandalism during the shift A few cameras located sporadically throughout the mall recorded two dark figures moving in and out of the shadows As usual, there’s nothing notable to report, he clocks out and heads home. The next morning, however, he's greeted by an angry mall manager. He learns that sometime during his shift, three stores were robbed and a back hallway vandalised. A few closed-circuit cameras located sporadically throughout the mall recorded two dark figures moving in and out of the shadows at about 4 am. The mall manager demands an explanation, and Daryl has none, “They must have been hiding during closing time and then waited for me to pass before acting,” he says. “I can only be in one place at one time. And if they were hiding in a dark hallway, I would never have seen them.” Theft explanation “Actually,” explains the manager, “we found a loading door ajar near the furniture store. We’re guessing that’s how they got in, but we can’t be sure. Do you check all the docks? We need to know if we need to replace a lock. Look at your logs - tell me exactly what you saw and when.” Daryl tries to recall. “I'm pretty sure I checked that one a couple of times. I checked it off my list.” Darrell decides not to mention that at 4:00 AM, he was feeling the night's fatigue and might have skipped that area a couple of times. That's the end of our tale. Poor Daryl is not a bad security guard, but he’s only human. His job is repetitive and unstimulating. Darryl's work log He checks off each location for the record, but there's no way for him to record the thousands of details Let’s discuss his hourly log. He checks off each location for the record, but there's no way for him to record the thousands of details he sees to later zoom in on the few observations that might be helpful for an investigation. He has walked by that loading dock door hundreds of times, and it's all a blur. This isn’t an unusual story; Darryl is doing the same job that humans have been doing in almost precisely the same way for millennia. And, like last night, the criminals have always found a way to avoid them. But there is a better way. Solution: Fully-automated indoor drone Replacing a human guard with a fully-automated indoor drone eliminates virtually all the problems we've identified in this story as it flies through the facility: Drone teams can work 24/7: While each drone needs to dock to recharge its battery periodically, a fleet working in concert can patrol around the clock in multiple areas simultaneously. This makes it much more difficult for an intruder to move freely, without risk of discovery. A drone can even keep an eye out and keep recording while docked. Drones see and log everything: Everything is recorded and stored in full detail as they compare what they see with what they expect to see High-resolution onboard cameras and ultrasensitive sensors can detect heat, movement, and moisture, and see into dark areas much more effectively than the human eye. As they aren't limited to the floor, they can also fly high in the air to look above obstacles and at high windows or warehouse shelves. And they don’t lose focus or get bored as the night drags on: Everything is recorded and stored in full detail as they compare what they see with what they expect to see based on a previous flight. Anything unusual triggers an alert. Drones don’t need vacations, snack/bathroom breaks, or new-recruit training: Without the need to deal with biological requirements, you aren't paying for non-work hours, and there’s no overtime for extra hours or holiday shifts. In a high-turnover business like security, there's no time spent training new employees; adding drones to your fleet simply means installing your existing procedures onto each. There is certainly room for judgment calls that require human intervention, but these can often be handled remotely using a control panel that provides all relevant data and alerts from the drones on duty. That means no scrambling to the office in the middle of the night for a false alarm. Drones outshine stationary cameras and the people staring at those screens: A guard in the security office staring at dozens of these screens usually loses their attention span throughout the shift Close-circuit cameras are expensive to install, maintain, and periodically replace. In addition, they are limited in their scope and, almost by definition, leave large blind spots. A guard in the security office staring at dozens of these screens (that generally show nothing notable) usually loses their attention span throughout the shift. Conclusion In short, there is a good reason that our industry is following close on the heels of the manufacturing industry, which has been eagerly adopting robotics as a more cost-effective and precise solution for years. It is simply becoming harder and harder to justify the expense of the traditionally error-prone and monotonous work that we ask of our security guards.
The last year revolutionised the way people work. When offices transitioned to work-from-home and worksites implemented social distancing, the security industry saw an overnight shift in what technologies our customers wanted. Now that businesses are bringing employees back to work in-person, management has broadened their focus to include healthy access in their security plans. Healthy access is a modern security concept that uses the latest technologies to blend employee and visitor health with automated security and digital transformation. This year, more leaders than ever are concerned with the health of their people – for good reason. Touchless Solutions Touchless solutions are at the forefront of security conversations because, suddenly, no one wants to touch anything in public. As a result, biometric solutions using face recognition have adapted to deliver a powerful and highly effective trifecta of solutions for physical security, health and workforce management. Face recognition is now considered to be the most accurate non-invasive method to identify and authenticate individuals Face recognition is now considered to be the most accurate non-invasive method to identify and authenticate individuals. Ongoing improvements like smarter algorithms, neural networks and artificial intelligence (AI) continue to improve face recognition’s performance. Well-known enhancements like faster processing and better camera functionality are quality-of-life improvements for traditional face recognition applications. Other advancements – like mask detection, face recognition while wearing a mask, mobile enrolment and more – are unique additions to this technology that effectively answer the needs of today without adding complex workflows. Biometric Face Recognition for Physical Security Even as pandemic mask restrictions lift, many businesses still require people to wear face masks to enter their facilities – a policy that will be with us for years to come. The sudden requirement for face masks in public stimulated the rapid development of a new face recognition application where security systems need to authenticate people with half their face covered. The ability to use a person’s biometrics to gain access eliminates the need for PINs or cards that can be forgotten, shared or stolen, so businesses familiar with the high security of biometrics cannot turn to less-secure means of authentication, and fingerprint is not a feasible option because that technology involves touching shared surfaces. Face recognition while wearing a mask is a highly relevant, timely advancement for businesses that need high security at their entry doors without compromising on mask mandates or personal comfort levels with illness avoidance. Biometric Face Recognition for Health Face recognition is touchless by nature and took centre stage during the pandemic Face recognition is touchless by nature and took centre stage during the pandemic as buildings migrated to contactless security to limit the spread of surface-borne illnesses. As more businesses reopen and bring office staff back, the demand for this fast, easy-to-use and touchless technology will continue to surge. Additionally, advanced face recognition solutions can be enhanced with thermographic cameras for elevated body temperature detection, which enables businesses to limit access to only people with healthy temperatures and prove that they are protecting healthy staff. To adhere to social distancing guidelines, businesses can take advantage of our society’s affinity for mobile apps. Remote enrolment is a feature of high-end face recognition solutions where people can enrol their faces using their phones – limiting the amount of time spent waiting in line, standing in front of a device or interacting with other people. Some solutions are also integrated with attestation questionnaires that allow people to self-declare symptoms or exposure to illnesses, which can help businesses make informed decisions to protect the health of their staff. The more your solution can accomplish, the more confidence your personnel can have that they are healthy at your building. Biometric Face Recognition for Workforce Management Returning to work is now a monumental undertaking. One of the biggest challenges for business owners is balancing hybrid work-from-home schedules and socially distanced in-person shifts. Every business will have a unique approach to what work in a post-pandemic world looks like. Touchless, mask-inclusive technology and attestation are user-friendly solutions that help businesses protect staff health This adds a new layer of complexity to shift scheduling that management must address to maintain the simplicity of shift changes and accuracy of time tracking. Touchless, mask-inclusive technology and attestation are user-friendly solutions that help businesses follow mask rules, ensure high security, protect staff health and keep shift changes fast and easy. Advancements in face recognition align with the timing of getting employees back to work because of work done by proactive security leaders. The “face” of biometrics has forever changed. This industry is no longer represented by antiquated fingerprint technology. Instead, we are represented by modern, accessible face recognition with room to grow for physical security, health and workforce management – the trifecta of healthy buildings.
James Twigg is the Managing Director of Total Integrated Solutions (TIS), an independent life safety, security and communication systems integrator, specialising in design & consultancy, technology and regulatory compliance. Total Integrated Solutions work primarily with retirement villages, helping to ensure the safety of residents in numerous retirement villages across the country. In this opinion piece, James shares how smart technology is helping security teams and care staff alike in ensuring the safety and security of their spaces, amid the COVID-19 pandemic and beyond. Impact of smart technology Smart technology is having an impact on pretty much every aspect of our lives Smart technology is having an impact on pretty much every aspect of our lives. From how we travel, to how we work, to how we run our homes. It’s not unusual to have Alexa waking us up and ordering our groceries or Nest to be regulating the temperature and energy in our homes. And while there’s a popular misconception that people in their later years are allergic to technology, retirement villages and care homes are experiencing significant innovation too. And the result is not only improved quality of life for residents, but also improved safety and security systems for management teams. Switching to converged IP systems I’ve been working in the life safety and security industry for over fifteen years. When I first joined TIS, much of the sector was still very analogue, in terms of the technology being installed and maintained. Slowly but surely, we’ve been consulting and advising customers on how to design, install and maintain converged IP systems that all talk to each other and work in tandem. I'm excited to say retirement villages are some of the top spaces leading the way, in terms of technological advancement. Improving the quality of life for residents A move into a retirement village can be daunting and one of the key concerns that we hear about is the loss of independence. No one wants to feel like they are being monitored or to have someone constantly hovering over them. One of the ways we’ve used smart technology to maintain residents' independence is through devices, such as health monitors and motion sensors. For example, instead of having a member of staff check-in on residents every morning, to ensure they are well, sensors and analytics can automatically detect changes in routine and alert staff to possible problems. Similarly, wearable tech, such as smart watches give residents a chance to let staff know they are okay, without having to tell them face-to-face. As our retirement village customers have told us, a simple ‘I’m okay’ command can be the difference between someone feeling independent versus someone feeling monitored. Simplifying and improving security systems Smart technology gives care staff and security oversight of the needs of residents For the teams responsible for the safety of the people, places and spaces within retirement villages, smart technology is helping to improve and simplify their jobs. Smart technology gives care staff and security oversight of the needs of residents, and ensures rapid response if notified by an emergency alert, ensuring they know the exact location of the resident in need. And without the need to go and physically check-in on every resident, staff and management can ensure staff time is being used effectively. Resources can be distributed where they are needed to ensure the safety and wellbeing of those residents who need extra consideration. 24/7 surveillance When planning the safety and security for retirement villages, and other residential spaces, it’s no use having traditional systems that only work effectively for 12 hours a day or need to update during the evening. Surveillance needs to be 24/7 and smart technology allows that without the physical intrusion into people’s spaces and daily lives. Smart technology ensures that systems speak to each other and are easily and effectively managed on one integrated system. This includes video surveillance, which has also become much more effective as a result of advanced video analytics, which automatically warn staff of suspicious behaviour. Securing spaces amid COVID-19 This year has, of course, brought new challenges for safety. COVID-19 hit the retirement and residential care sectors hard, first with the initial wave of infections in mid-2020 and then, with the subsequent loneliness caused by the necessary separation of families. As essential workers, we worked closely with our customers to make sure they had everything they needed As essential workers, we worked closely with our customers to make sure they had everything they needed during this time, equipping residents with tablet devices to ensure they could stay connected with their families and friends. It allowed residents to keep in touch without risking transferring the virus. Thermal cameras and mask detection And now that we’re emerging out of COVID-19 restrictions and most residents can see their families again, we’re installing systems like thermal cameras and mask detection, so as to ensure that security will be alerted to anyone in the space experiencing a high temperature or not wearing proper PPE. Such steps give staff and families alike, the peace-of-mind that operational teams will be alerted at the earliest possible moment, should a COVID-19 risk appear. Thinking ahead to the next fifteen years, I’m excited at the prospect of further technological advancements in this space. Because at the end of the day, it’s not about how complex your security system is or how you compete in the industry. It’s about helping teams to protect the people, spaces and places that matter. I see smart technology playing a huge role in that for years to come.
Security beat
Thermal cameras can be used for rapid and safe initial temperature screening of staff, visitors and customers. Used the right way, the cameras can help prevent unnecessary spread of viruses like the novel coronavirus. During the global pandemic, use of thermal cameras has increased, but they have not always been used correctly, and therefore, not effectively. Hikvision’s temperature screening thermal products are currently assisting users in initial temperature screening across the global market. During 2020, demand increased in most markets, and the company highly recommends that Hikvision’s thermographic cameras be used in accordance with local laws and regulations. Limitations of the technology include throughput and the impact of ambient conditions. Detect viruses and fever Hikvision releases a video that illustrates how skin temperature measurements are normalised within minutes Thermal cameras cannot detect viruses and fever and should only be used as a first line of screening before using secondary measures to confirm, says Stefan Li, Thermal Product Director at Hikvision. “We also believe it is important for businesses and authorities to use [thermal cameras] alongside a full programme of additional health and safety procedures, which includes handwashing, regular disinfection of surfaces, wearing protective clothing such as masks, and social distancing.” Hikvision has released a video that illustrates how skin temperature measurements are normalised within minutes after someone emerges from the cold. Mr. Li says the video demonstrates the accuracy of forehead measurement under difficult circumstances when people come inside from a cold outdoor environment. Temperature screening facilities “There have been some claims that measuring the forehead temperature is not as accurate as measuring the inner canthus, and we believe this video demonstrates the accuracy of forehead measurement very well,” he says. “We also illustrate how the skin temperature will experience a process of recovery (warming up), no matter if it is measured by a thermal camera or a thermometer.” Mr. Li adds that people should wait five minutes in such circumstances before starting a temperature measurement. “We hope that stakeholders who are involved in the design of temperature screening facilities and associated health and safety procedures will recognise how important it is to consider the skin temperature recovery time, and that forehead measurement can provide accurate test results,” says Mr. Li. Thermal imaging manufacturers The algorithm is based on a large number of test results to obtain a value that tends to be dynamically balanced The temperature measurement principle of thermal imaging is to detect the heat radiation emitted by the human body. The detected heat value often does not reflect the true internal body temperature of an individual. Furthermore, the temperature varies among different parts of the human, such as the forehead, ears, underarms, etc. A temperature compensation algorithm can be used to adjust the measured skin temperature to align with the internal body temperature. The algorithm is based on a large number of test results to obtain a value that tends to be dynamically balanced. At present, thermal imaging manufacturers in the market, and even forehead thermometer manufacturers, have developed their own algorithms to map the skin temperature measured by the camera to the internal body temperature, so as to compensate the skin temperature to the internal body temperature. Thermal cameras This is also why Hikvision recommends that the "actual body temperature" should be checked with a secondary device for confirmation. The calibration work for a thermal camera is completed in the production process at the factory, including calibration of reference values and detection point and so on. At the same time, the equipment parameters should be adjusted before on-site use to ensure accurate temperature reads. Hikvision does not deny the accuracy of temperature measurement at the inner canthus but prefers forehead temperature measurement and algorithms based on actual use scenarios, says Mr. Li. A large amount of test data and practical results indicates that the forehead is a correct and easy-to-use temperature measurement area, says the company. There are advantages and disadvantages of choosing different facial areas for temperature measurement. Default compensation temperature Two main approaches direct the measurement area and how compensation algorithms are applied: Forehead area + default forehead compensation algorithm value Upper half face (forehead + canthus) + default inner canthus compensation algorithm value. Both methods deploy compensation algorithms, but the default compensation temperature of the inner canthus will be less than the default compensation temperature of the forehead, generally speaking. The reason is that the temperature of the inner canthus of most people is higher than their forehead, so the temperature compensation is relatively low (i.e., closer to the actual temperature inside the body.) Upper face area Hikvision found that selecting the upper face area plus the default compensation value for the inner canthus resulted in situations when the calculated temperature is lower than the actual temperature. For the Hikvision solution, the forehead is a relatively obvious and easy-to-capture area on an entire face Mr. Li explains: “The reason is that when the camera cannot capture the position of the inner canthus (for example, when a person is walking, or the face is not facing the camera), the camera will automatically capture the temperature of the forehead. Then the result that appears is the sum of the forehead temperature plus the default compensation temperature of the inner canthus, which is lower than the actual temperature of the person being measured. Therefore, errors are prone to occur.” Thermal imaging products But for the Hikvision solution, the forehead is a relatively obvious and easy-to-capture area on an entire face. Also, the default forehead compensation temperature is based on rigorous testing and can also correctly mimic the actual temperature of the person being measured, says Mr. Li. After many test comparisons, considering that the results of forehead temperature measurement are relatively more stable, and in order to avoid the false results from inner canthus temperature measurement, Hikvision chose the forehead temperature measurement approach. “We look forward to bringing thermal imaging products from a niche market where there is a relatively high-end industry application to a mass market and serving more users,” says Mr. Li. Facial recognition terminals Additional application parameters can maximise effectiveness of thermal cameras for measuring body temperature: Positioning and height - All cameras must be mounted appropriately to avoid loss of accuracy and performance. The installation height of each camera must be adjusted according to camera resolution and focal length, and stable installation is needed to avoid errors caused by shaking. Ensuring a ‘one-direction path’ - The detection area must ensure that cameras capture the full faces of all those passing by or stopping, and obstacles should be avoided in the field of view, such as glass doors that block the camera. Adequate start-up and usage - A waiting time of more than 90 minutes is required for preheating, after the initial start-up. Before conducting a thermal scan, people should be given three to five minutes to allow their body temperature to stabilise. When Hikvision MinMoe facial recognition terminals are used, people must stand at a fixed distance, pass one by one, make a short stop, and face the camera directly. Hikvision cameras support efficient group screening, but one-by-one screening is suggested for more accurate results, says Mr. Li. Unstable environmental condition An unstable environmental condition may affect the accuracy of thermal camera systems Environmental factors can impact the accuracy of thermal cameras, and the idea of using a black body is to provide the camera with a reference point that has a stable temperature. The black body is heated to a specific temperature and helps the thermal camera to know how much error is caused by environmental factors in the room, and how the camera should calibrate itself in real time to improve its accuracy. A black body can help increase the temperature measurement accuracy, and the most common improvement is from ±0.5 degrees to ±0.3 degrees. However, it also increases the cost of the installation. In some markets, customers may require black bodies in order to comply with regulatory accuracy requirements. An unstable environmental condition may affect the accuracy of thermal camera systems for measuring temperature. Medical temperature measurement Therefore, Hikvision suggests that the ambient conditions should be met for installation and use. First of all, users should avoid installing devices in hot or changeable environments. All cameras require indoor environments with calm air, consistent temperature and no direct sunlight. Installation should also be avoided in semi-open locations that may be prone to changes in ambient conditions, such as doorways, and there should be enough stable, visible light. All devices should be installed to avoid backlighting, high temperature targets, and reflections in the field of view as far as possible. “We often see the misconception that thermal cameras can replace medical temperature measurement equipment, which is not the case,” says Mr. Li. Rapid preliminary screening “Temperature screening thermographic cameras are designed for the detection of skin-surface temperatures, and the measurement should be conducted to achieve rapid preliminary screening in public areas. It is really important that actual core body temperatures are measured subsequently with clinical measurement devices.”
The coronavirus pandemic had a monumental impact on all aspects of the business world, including the security industry. However, amid the gloom and doom, many security professionals also saw opportunity: New ways the industry’s products could be applied to address the challenges of coping with the virus. This article will review some of those opportunities, based on our reporting throughout the year and including links back to the original articles. During and after the pandemic, security systems are an important asset when it comes to helping to keep occupants and buildings safe as employees return to work. For example, video analytics can provide insight into how spaces have previously been used and can help to predict where and when occupants encounter each other or congregate. Role of thermal cameras These foot-traffic patterns can inform settings for a variety of devices - like ventilation and temperature controls - and even help owners create social distancing plans and monitor personal protective equipment (PPE) compliance. Thermal surveillance, a mainstay of traditional physical security and outdoor perimeter detection, began being deployed early in the pandemic to quickly scan employees, contractors and visitors as part of a first line of defence to detect COVID-19 symptoms. These systems provide flexibility and can offer integrations with multiple VMS platforms and access control devices These systems provide flexibility and can offer integrations with multiple VMS platforms and access control devices. Thermal cameras can be a tool for detecting fever, but any use of the technology for this purpose is full of qualifications and caveats. Importantly, how the camera system is configured makes all the difference in whether temperature readings are accurate, and the downside of inaccurate readings is obvious - and potentially deadly. Temperature detection systems FDA guidelines limit how the cameras are used, not to mention guidance from other regulatory/government bodies such as the CDC. One of our Expert Roundtable panelists compares the market to a “wild west scenario,” and almost all the panelists are clear about how customers should approach the market: Buyer beware. There are many companies jumping into selling temperature detection systems to the state, local governments, hospitals, airports and local businesses, but do they know how to drive one? Anyone can get behind a car and drive it into a wall by accident. The same can happen with a temperature detection system. Customers need to know what questions to ask to ensure they maximise the accuracy of body temperature detection systems. Rise of contactless Spread of the novel coronavirus has jolted awareness of hygiene as it relates to touching surfaces such as keypads. No longer in favor are contact-based modalities including use of personal identification numbers (PINs) and keypads, and the shift has been sudden and long-term. Both customers and manufacturers were taken by surprise by this aspect of the virus’s impact and are therefore scrambling for solutions. Immediate impact of the change includes suspension of time and attendance systems that are touch-based Immediate impact of the change includes suspension of time and attendance systems that are touch-based. Some two-factor authentication systems are being downgraded to RFID-only, abandoning the keypad and/or biometric components that contributed to higher security, but are now unacceptable because they involve touching. "Users do not want to touch anything anymore,” says Alex Zarrabi, President of Touchless Biometrics Systems (TBS). Facial recognition system Another contactless system that benefits from concerns about spread of COVID-19 is facial recognition. New advancement in software, specifically in the areas of algorithms, neural networks and deep learning and/or artificial intelligence (AI), have all dramatically improved both the performance and accuracy of facial recognition systems, further expanding its use for an increasing number of applications. A low-tech solution - the face mask - became a leading preventative measure during the pandemic. But, a high-tech solution is necessary to ensure that everyone is wearing them. Cameras powered by artificial intelligence can now identify whether or not people entering a facility are wearing facemasks and help enforce adherence to mask mandates. This technology is proving to be a cost-effective solution that reduces risks of confrontations over masks policies and gives managers the data they need to document regulatory compliance and reduce liability. Smart video analytics Other technology approaches, including artificial intelligence (AI), were also brought to bear during the pandemic. The German data analytics powerhouse G2K, for example, has developed a Corona Detection and Containment System (CDCS) that is ready for immediate use in record time. Detection takes place in combination with AI-supported data analysis to specifically identify virus hotspots and distribution routes, as well as to identify other potentially infected persons. One specific AI application fuels the reopening of the world and successfully keeps the spread of the virus abated One specific AI application fuels the reopening of the world and successfully keeps the spread of the virus abated. A “collaborative security” application includes a synthesis of smart video analytics, facial recognition, object identification/detection, and thermal cameras that can support the reopening of businesses globally when installed within those facilities frequented by customers. Enforcing social distancing Several applications have been successful to date and will increase in usability in the foreseeable future, creating “smart cities” working together towards a safer, more secure world. The site of one pilot programme is the 250,000-square-foot HID Global facility in Austin. For the pilot programme, 80 HID Location Services readers were installed in a wide area in the facility, including a variety of environments. Initially 30 badges and 30 fobs, all BLE-enabled, were issued to employees. If a badge identifies another nearby beacon (suggesting a social distancing failure), it emits a blinking LED light, which can be seen by the offending co-worker. To ensure social distancing, a Bluetooth Low Energy (BLE) beacon is emitted from an employee’s fob (or from a badge that has the same functionality). The beacon communicates peer-to-peer with a beacon emitted by another employee’s fob or badge to alert if the location of the two employees is less than six feet apart. For contact tracing, the beacons communicate via a nearby “reader” (a BluFi BLE-to-Wi-Fi gateway) to the Bluzone cloud-based software-as-a-service. COVID-19 white papers In addition, we published several White Papers in 2020 that addressed various aspects of the coronavirus pandemic. They included: The top five security lessons learned that apply across all industries navigating COVID-19. Using video analytics to keep staff, visitors and customers safe by enforcing social distancing. How antimicrobial treatment on door handles and levers can reduce disease spread. How companies can put in extra precautions that will continue to grow and adapt with their environment over the long-term. Determining the practicalities and capabilities of today's thermal cameras to accurately detect body temperature.
Sooner or later (hopefully sooner), the novel coronavirus global pandemic will allow workplaces to reopen. But as we move into this recovery phase, there are many questions surrounding the transition. How can companies ensure facilities are in acceptable working order to reopen? How do they decide who is coming back and when? How will social distancing impact the operation of a company’s physical access control system? How can companies ensure that both visitors and employees are aware of the policy changes and extra controls? For answers to these and other salient questions, we called on Ian Lowe, Product Marketing Director of HID SAFE Identity and Access Management (IAM) solutions. “There’s no doubt about it: the global pandemic will change the way we live, work, and conduct business for some time,” says Lowe. “Over the past several weeks, we have been working with customers to enable a safe return to the workplace. We have observed that the number of challenges in the mid-to-long-term level and the associated complexity vary by location.” Lowe shares some of the proactive measures and best practices that can assist in a safe return to the workplace as we settle into a “new normal”. Challenge 1: Ensuring building readiness After being unoccupied for weeks or months, building readiness must be addressed completely before welcoming anyone inside. Even though employees may be eager to return, the workplace itself may not be ready. Companies may want to consider continuing remote work while facility operations are prepped. Challenge 2: workforce management There’s no doubt about it: the global pandemic will change the way we live, work, and conduct business for some time While it is dependent on location and industry, taking a phased approach is the best course of action when allowing employees, contractors and visitors back into facilities. First, facilities management will want to survey the property for readiness and then provide an estimate as to when employees may begin reporting back into the office. Next, it’s important to consider that office density needs are interrelated to the facility architecture. It is possible to accommodate a higher capacity of workforce in an airy, open office space than in a constrained one. A good rule of thumb is to start by introducing no more than 30% of employees back into the workplace at first. This could be a rolling group model in which the population total remains controlled and constant, but specific individuals vary from day to day. This option is good for a workforce that needs to be together in person but not necessarily all at the same time due to office density concerns. Welcoming visitors or customers into the office should be delayed as long as possible. If that’s not feasible, visitor numbers should be factored into the total density count. A cloud-based visitor management system can help with implementation. Challenge 3: Controlling access The ability to vet staff, employees, contractors and visitors before and during the return will vary greatly depending on the location. Policies should be implemented that require employees to be screened regularly — and for an extended amount of time. Look to answer the following questions: Where have you visited in the days since last entering the workplace? Have you come into contact with anyone else who has recently visited high-risk areas? Have you shown any symptoms of infection in the past xx number of days? Policies should be implemented that require employees to be screened regularly — and for an extended amount of time If there is cause for concern, refuse the visitor and/or supplement the screening process with additional steps. Temperature checking is mandatory in many organisations— often multiple times a day. This applies to interactions at delivery bays, too. A policy-based physical identity and access management solution integrated with existing physical access controls makes it possible to enforce, monitor and report this type of activity. Challenge 4: Social distancing and contact tracing plan Social distancing may continue within the office, which will impact restrictions and guidelines related to access control. The office layout may be reworked for proper distance between cubicles, workplace positions and employees. Specific entrances, exits and pathways may be designated as one-way-only. Assigning Bluetooth LE beacons to employees once they are inside the workplace will allow companies to monitor proximity to others and measure localised density in real-time by using location services, contact tracing, and surge response technologies. Challenge 5: Reduced physical touchpoints Contactless technologies can help enforce social distancing and reduce touchpoints on common surfaces Reducing the number of physical touchpoints is desirable throughout a workplace. Contactless technologies can help enforce social distancing and reduce touchpoints on common surfaces such as faucets, doorknobs, coffee pot handles, etc. While introducing additional security checks and screenings, it’s important to not increase touchpoints and further infection risks. There have been more requests for a contactless experience to secure workplace access, including automatic doors and turnstiles, contactless cards and mobile access. Challenge 6: Communicating for confidence Proactive communication is key to provide reassurance that appropriate safety measures have been taken and that both visitors and employees are aware of the policy changes and extra controls. Equally important is to communicate a policy change – and the reasoning behind it – before it happens. While there may not be an exact expiration date on these new policies, ensuring that impacted individuals will have a safer experience is universally appreciated.
Case studies
The Greening Campaign, founded by Terena Plowright, has set its sights on an ambitious goal: to make the entire United Kingdom greener, one community at a time. This initiative seeks to address a pressing concern—the widespread lack of awareness about the importance of energy efficiency within homes. According to Citizen’s Advice, the average UK home loses approximately £350 each year due to poor insulation. This loss escalates to as much as £951 annually for the least efficient homes. These figures show the significant financial impact of energy inefficiency on homeowners across the country. Complicating the situation further is the fact that many of the critical areas where heat loss occurs are invisible to the naked eye. This challenge requires the use of specialised equipment capable of detecting and addressing these elusive energy leaks. Given that the Greening Campaign operates primarily through the efforts of volunteers, the tool needs to be not only effective but also user-friendly. Solution Recognising the need for an accessible tool to identify and demonstrate energy inefficiency, the Greening Campaign selected the FLIR C5 compact thermal camera for its user-friendly design. Terena explained, "When we were looking at the camera, we were thinking about, 'What would people be confident to use?' We chose the FLIR C5 because it resembles a mobile phone." The FLIR C5 cameras were distributed to community members, enabling them to visually detect Colin, a volunteer for the Greening Campaign and a surveyor, shared his excitement about the potential of thermal imaging to reveal numerous solutions to energy loss problems; ‘’It was fascinating to hear how many answers there are to the problems people have of energy loss through losing heat. I, personally, as a surveyor was fascinated to see what results we’d get from using a thermal camera.’’ The FLIR C5 cameras were distributed to community members, enabling them to visually detect where heat was escaping from their homes, thereby making the invisible, visible. Colin gives details on his and the volunteer's first outing with the thermal cameras, ‘’We went out to our first few, very much, as amateurs. We played around with the cameras—it took around half an hour, and that’s all, to understand it.’’ Results Volunteers equipped with thermal cameras have been able to demonstrate the tangible benefits of energy efficiency to homeowners in a visually impactful way. Terena shares the positive effect of making it easier for people to understand and address heat loss issues: "When you’re telling people about energy loss, it’s very difficult to get them to really see that, but when you’ve got it in technicolour, right in front of them, they really understand where that heat loss is. And this is the beauty of these cameras; you can see where roof insulation has even the smallest gaps—it will show through." The campaign has created a ripple effect, with more than 200 wards now fitted to pass on their facts Kirsty, a community member, explains her experience with the initiative: "Everyone was really friendly; we looked at every window and door together, picked out areas that I might not have noticed—it was really beneficial to do. I’m definitely concerned about reducing my carbon footprint." She also highlights some simple answers to heat loss: "Little things like draft excluders—everyone can use those, shutting the curtains early, keeping all the heat in—and it doesn’t have to cost a lot." Moreover, the campaign has created a ripple effect, with more than 200 communities now equipped to pass on their knowledge and experiences to others. This grassroots movement, powered by the dedication of volunteers and the innovative use of FLIR thermal cameras, is creating a patchwork of energy-efficient communities. As Colin put it, "What each of us can do—we're a drop in the ocean, but, actually, all together, we are that ocean; we can make those changes." The success of the Greening Campaign underscores the power of community engagement, accessible technology, and hands-on education in driving significant environmental change. It's a compelling model for how local actions can contribute to global solutions, one community at a time.
Located in downtown Houston, Texas, USA, at the George R. Brown Convention Center (GRB), the Houston Living Lab (HLL) serves as a testing ground for city departments and partners to test and validate new technology. In 2017, the Houston First Corporation (HFC) established the lab following a successful collaboration with Milestone Systems and several other security manufacturers to rapidly deploy video technologies for nearly one million attendees at the Super Bowl Live festival. Now HLL develops smart city solutions for deployment across Houston. Security technology solutions With the help of the Houston First Corporation — a local government corporation created to operate the city's convention and performing arts facilities — the City of Houston hosts many high-profile events annually. One of HFC's long-term goals is establishing Houston as a pioneer in smart city initiatives to further promote the region as a tourism and convention business destination. City of Houston and HFC needed to bring together technology partners and build on living infrastructure To accomplish this goal, the City of Houston and HFC needed to bring together technology partners and build on existing infrastructure to further enhance public safety and security during events. In 2017, the city hosted Super Bowl LI, an event that became a literal game changer in how the city rapidly deploys integrated security technology solutions. Legacy security systems The 10-day Super Bowl Live festival at the 12-acre Discovery Green featured free well-known music artist concerts and other attractions. The neighbouring GRB hosted the NFL Experience event with interactive activities and player appearances. When hosting large events spread out over several venues, the city found that the added congestion from portable event stages, booths, and attendees changed the environment. This rendered the standalone legacy security systems inadequate when hosting the events. “In these situations, the green space is no longer open; it’s cluttered with event structures, banners, and everything that comes with a festival. We found that our existing camera system was getting either visually or audibly interfered with,” said Jack C. Hanagriff, former Program Manager for the City of Houston’s Office of Public Safety and Homeland Security. Access to the camera system In the six-month planning period before the festival, Verizon installed fibre-optic cable for the event Determining a temporary system was needed to provide security at Super Bowl Live, Hanagriff and his team brought in Milestone Systems on the recommendation of HFC's long-time integrator Teksys and manufacturer Axis Communications. Milestone helped design and test a rapidly deployable, fully integrated supplemental camera and video management software (VMS) system at Discovery Green. In the six-month planning period before the festival, Verizon installed fibre-optic cable for the event. This allowed access to the camera system with Axis F Series modular cameras, Q Series PTZ dome cameras, and thermal imaging systems. Milestone open platform Using a Milestone open platform system design, the temporary festival infrastructure easily integrated with the non-Milestone VMS already used at GRB. The system was built on the Milestone design. “We were able to tie both VMS networks into our existing homeland security network. We converged the two systems to give law enforcement, the fire department, and other agencies access to all systems seamlessly,” said Jack C. Hanagriff, adding “Again, this system did not exist just four days prior.” Houston Living Lab inspires Smart City R&D HLL allows city departments and partners to test and validate technology in an active environment After successfully collaborating with Milestone Systems and other security manufacturers for the Super Bowl Live events, HFC established the Houston Living Lab. The HLL allows city departments and partners to test and validate technology in an active environment. Technology partners include Milestone Systems, Axis Communications, Cradlepoint, Dell Technologies, Haystax, Acre Comnet (formerly Razberi), Siklu, and Verizon. Video analytics are provided by Athena Security, Citilog, EAGL Technology, Evolon Technology, Irisity (formerly Agent Vi), Sound Intelligence, and AirSight (formerly 911 Security). Technology Partnerships Enhance Public Safety The 1.9 million-square-foot GRB Convention Center has diverse security needs. Beyond public safety and monitoring aggressive behaviour in and around the centre, the security team proactively improves traffic at intersections and manages four large parking garage operations. In 2021, HFC worked with Houston Public Works (HPW) on designing and installing an on-premises software solution to easily bring together the latest technologies at GRB. The 1.9 million-square-foot GRB convention centre has diverse security needs Milestone video management technologies provide seamless integrations with cutting-edge security applications. Nearly 600 legacy Axis Communications cameras are integrated with Milestone Smart Walls in multiple security and parking command centres spread across facilities in the theatre and convention districts, providing complete situational awareness at any given moment. Relationships built at the HLL HFC wanted to be able to identify dangerous situations and be proactive rather than reactive to help mitigate risks. They now have visibility into different situations, such as vehicles driving the wrong way, large crowds gathering in an area or even listening for glass breaking, car alarms, gunshots, or aggressive behaviours. “The relationships built at the HLL were instrumental in helping us support the needs at other high-profile sites throughout the city that were identified with concerns regarding general public safety and quality of life,” added Jack C. Hanagriff.
A recycling company specialises in processing corrugated paper in large “railroad-car-sized” amounts. This process entails sending the cardboard to a shredder and ultimately, producing craft paper, which creates high levels of heat. When the metal bands that hold the cardboard bundles together are cut, there is potential for a spark to be created, resulting in a fire hazard. Need for proactive measures To avoid increases in their insurance rates, it was acknowledged that more proactive measures needed to be in place at the plant. The existing cameras could not provide the capabilities needed for prevention such as detecting smoke in the air from the heat before a fire erupted and spread. Further, they needed to integrate the camera smoke/heat detection notifications with the fire alarms so there would be real-time alerts for the staff. Solution used The benefits of installing new thermal cameras and creating maps from multiple walk-throughs Andrew Lundberg, Account Rep, Konica Minolta, was acquainted with the plant, and along with Sales Manager, Antonette Tobin, provided a security overview to the general manager. The team worked with Scott Browne, Video Security Solutions Executive, to show the company’s senior leadership the benefits of installing new thermal cameras and also created maps from multiple walk-throughs. MOBOTIX cameras The Konica Minolta team addressed installation concerns by explaining how they could run the wire to accommodate the best location for the furnaces and operational points where a fire could start. Further, the plant manager was informed about the durability of the German-made MOBOTIX cameras in extreme temperature conditions since their plant created a hot environment. “When we saw that the MOBOTIX cameras operated in harsh environmental conditions with very cold and very hot temperatures, we were relieved that the camera quality and operations would hold up well at our plant,” added the GM. Results Konica Minolta could also have the cameras directly integrated with their fire alarm systems The plant purchased three MOBOTIX M16 cameras with thermal sensors for the interior of their facility. With a wide field of view, the cameras could cover the key areas where they felt smoke would need to be detected to proactively provide the alerts. They were pleased that Konica Minolta could also have the cameras directly integrated with their fire alarm systems, providing the proactive operational improvement that the insurance company required. Improved workflow efficiency The installation of these new cameras would not only save them from additional insurance costs but also reduce the stress on employees who previously had to be on high alert to prevent potential fire problems. This technology addition enabled the team to improve workflow efficiency, with employees focused on the operations. Once the board approved the funding, the plant GM indicated that in the future, he would like to consider additional outdoor cameras. Operational oversight Simply adding cameras to detect issues that may go unnoticed by employees helps with employee safety Proactively improving the oversight of his operations, he noted, could only help with their safety, security, and future evidence to the insurer that they had a proactive mindset. This solution applies nationwide, to organisations that want better oversight of their facilities and manufacturers that need operational oversight. Simply adding in cameras to detect issues that may go unnoticed by employees helps with employee safety. The story is simple, Konica Minolta can help to provide security via its Mobotix cameras, through its camera detection apps and react offerings. Preventive maintenance “We were eager to get this solution in place, but we could only install it during our shutdown period when we conducted our preventive maintenance,” said the plant General Manager (GM). "The Konica Minolta team worked on our timeline for funding approval from our leadership team and with our plant’s operational timing requirements."
Robots do monotonous workflows and less pleasant, repetitive tasks with brilliance. Combined with image processing, they become “seeing” and reliable supporters of humans. They are used in quality assurance to check components, help with the assembly and positioning of components, detect errors and deviations in production processes and thus increase the efficiency of entire production lines. An automobile manufacturer is taking advantage of this to improve the cycle time of its press lines. Together with the latter, VMT Vision Machine Technic Bildverarbeitungssysteme GmbH from Mannheim developed the robot-based 3D measuring system FrameSense for the fully automatic loading and unloading of containers. Pressed parts are thus safely and precisely inserted into or removed from containers. Four Ensenso 3D cameras from IDS Imaging Development Systems GmbH provide the basic data and thus the platform for process automation. Application The actual workflow that FrameSense is designed to automate is part of many manufacturing operations. A component comes out of a machine-here a press- and runs on a conveyor belt to a container. There it is stacked. As soon as the container is full, it is transported to the next production step, e.g., assembly into a vehicle. All these tasks are now to be taken over by a robot with a vision system-a technological challenge Up to now, employees have been responsible for loading the containers. This actually simple subtask is more complex than one might think at first glance. In addition to the actual insertion process, the first step is to determine the appropriate free space for the part. At the same time, any interfering factors, such as interlocks, must be removed and a general check of the “load box” for any defects must be carried out. All these tasks are now to be taken over by a robot with a vision system-a technological challenge. This is because the containers also come from different manufacturers, are of different types, and thus vary in some cases in their dimensions. Positioning of the components For their fully automatic loading and unloading, the position of several relevant features of the containers must be determined for a so-called multi-vector correction of the robot. The basis is a type, shape and position check of the respective container. This is the only way to ensure process-reliable and collision-free path guidance of the loading robot. All this has to be integrated into the existing production process. Time delays must be eliminated and the positioning of the components must be accurate to the millimetre. 3D point cloud These point clouds of all four sensors are combined for the subsequent evaluation To counter this, VMT uses four 3D cameras per system. The four sensors each record a part of the entire image field. This can consist of two containers, each measuring approximately 1.5 × 2 × 1.5 metres (D × W × H). Two of the cameras focus on one container. This results in data from two perspectives each for a higher information quality of the 3D point cloud. These point clouds of all four sensors are combined for the subsequent evaluation. In the process, registrations of relevant features of the container take place in Regions of Interest (ROIs) of the total point cloud. Interference contours Registration is the exact positioning of a feature using a model in all six degrees of freedom. In other ROIs, interference contours are searched for which could lead to collisions during loading. Finally, the overall picture is compared with a stored reference model. In this way, the containers can be simultaneously checked for their condition and position in a fully automated manner. Even deformed or slanted containers can be processed. All this information is also recorded for use in a quality management system where the condition of all containers can be traced. The calibration as well as the consolidation of the measurement data and their subsequent evaluation are carried out in a separate IPC (industrial computer) with screen visualisation, operating elements and connection to the respective robot control. Image processing solution The entire image processing takes place in the image processing software MSS developed by VMT The main result of the image processing solution is the multi-vector correction. In this way, the robot is adjusted to be able to insert the component at the next possible, suitable deposit position. Secondary results are error messages due to interfering edges or objects in the container that would prevent filling. Damaged containers that are in a generally poor condition can be detected and sorted out with the help of the data. The entire image processing takes place in the image processing software Multi-Sensor Systems (MSS) developed by VMT. FrameSense is designed to be easy to use and can also be converted to other components directly on site. Robust 3D camera system On the camera side, VMT relies on Ensenso 3D cameras-initially on the X36 model. The current expansion stage of FrameSense is equipped with the Ensenso C variant. The reasons for the change are mainly the better projector performance-thanks to a new projection process-as well as a higher recording speed. In addition, the Ensenso C enables a larger measuring volume. This is an important criterion for FrameSense, because the robot can only reach the containers to be filled up to a certain distance. The specifications of the Ensenso C thus correspond exactly to VMT's requirements, as project manager and technology manager Andreas Redekop explains: "High projector performance and resolution together with fast data processing were our main technical criteria when selecting the camera. The installation in a fixed housing was also an advantage.” Ensenso models Housing of a robust 3D camera system meets the requirements of protection class IP65/67 The Ensenso C addresses current challenges in the automation and robotics industry. Compared to other Ensenso models, it provides both 3D and RGB colour information. Customers thus benefit from even more meaningful image data. The housing of the robust 3D camera system meets the requirements of protection class IP65/67. It offers a resolution of 5 MP and is available with baselines from current to approx. 455 mm. This means that even large objects can be reliably detected. The camera is quick and easy to use and addresses primarily large-volume applications, e.g., in medical technology, logistics or factory automation. Outlook By automatically loading and unloading containers and the integrated 3D container inspection, manual workstations can be automated with the help of FrameSense. Against the background of the shortage of skilled workers, the system can thus make an important contribution to process automation in the automotive industry, among others. It meets the prevailing challenges of the industry. Ensenso C provides the crucial basis for data generation and exceeds the requirements of many applications. Lukas Neumann from Product Management sees their added value especially here: “The high projector power and large sensor resolutions are particularly advantageous in the field of intralogistics. Here, high-precision components have to be gripped from a great distance with a large measuring volume.” For other stacking or bin-picking applications in classic logistics, he could imagine a similar camera with high projector power but lower resolution and fast recording. So nothing stands in the way of further developments and automation solutions in conjunction with "seeing" robots.
Round table discussion
Many of us take critical infrastructure for granted in our everyday lives. We turn on a tap, flip a switch, push a button, and water, light, and heat are all readily available. But it is important to remember that computerised systems manage critical infrastructure facilities, making them vulnerable to cyber-attacks. The recent ransomware attack on the Colonial Pipeline is an example of the new types of threats. In addition, any number of physical attacks is also possibilities. We asked this week’s Expert Panel Roundtable: What are the security challenges of protecting critical infrastructure?
Large public events were out of the question during the depths of the pandemic. However, public events are likely to experience a resurgence along with a more optimistic outlook in the coming months. In addition, there will likely be pent-up enthusiasm for these events among individuals weary from months of isolation. We asked this week’s Expert Panel Roundtable: What are the security challenges of public events planners in 2021?
In the past few weeks, the light at the end of the COVID-19 tunnel has brightened, providing new levels of hope that the worst of the pandemic is behind us. Dare we now consider what life will be like after the pandemic is over? Considering the possible impact on our industry, we asked this week’s Expert Panel Roundtable: Which security technologies will be most useful in a post-pandemic world?
Products
![](https://www.sourcesecurity.com/img/carousel-nav.png)
![](https://www.sourcesecurity.com/img/carousel-nav.png)
White papers
![How security systems ensure healthy workplaces during COVID and after](https://www.sourcesecurity.com/img/white-papers/612/healthy-workplace-920.jpg)
How security systems ensure healthy workplaces during COVID and after
Download![Delivering a smart, secure and healthy workplace with cloud](https://www.sourcesecurity.com/img/white-papers/612/cloudvue-workplace-security-920.jpg)
Delivering a smart, secure and healthy workplace with cloud
Download![Building a safe ecosystem for visitors post COVID-19](https://www.sourcesecurity.com/img/white-papers/612/indigo-vision-920.jpg)
Building a safe ecosystem for visitors post COVID-19
Download![Thermal cameras: Can they accurately detect body temperatures?](https://www.sourcesecurity.com/img/white-papers/612/eagle-eye-networks-thermal-imaging-camera-920_1591961524.jpg)
Thermal cameras: Can they accurately detect body temperatures?
Download![How to catch shoplifters with thermal imaging](https://www.sourcesecurity.com/img/white-papers/612/flir-retail-surveillance-620.jpg)
How to catch shoplifters with thermal imaging
DownloadThermal imaging: Manufacturers & Suppliers
- FLIR Systems Thermal imaging
- DRS Thermal imaging
- Axis Communications Thermal imaging
- DALI Thermal imaging
- Bosch Thermal imaging
- Guide Infrared Thermal imaging
- Geutebruck Thermal imaging
- Videotec Thermal imaging
- Dahua Technology Thermal imaging
- Honeywell Security Thermal imaging
- RIVA Thermal imaging
- Pelco Thermal imaging
- LTV Europe Thermal imaging
- Hanwha Vision Thermal imaging
- Panasonic Thermal imaging