汽车之家
Chinese team develops intelligent vision sensor that turns light signals into AI-ready tokens, reducing use of energy_我的网站
A |
A Chinese research team from Nanjing University has developed a new ultra-low-power intelligent vision sensor chip, dubbed "LightTok," that can convert light signals into tokens within the sensor, significantly reducing the high energy consumption caused by frequent transfers of massive amounts of redundant data, the principal investigator told the Global Times.
According to a release from the Institute of Brain-Inspired Intelligence of Nanjing University, tokens generated by the LightTok chip can be directly fed into a Transformer encoder for image recognition.
"Our design idea was to move token generation onto the sensor itself, allowing the chip to directly produce tokens that AI models can process once light reaches the sensor," Miao Feng, director of the Institute of Brain-Inspired Intelligence at Nanjing University, told the Global Times on Thursday. "These tokens contain complete image information."
Physical AI refers to intelligent systems capable of autonomously perceiving, reasoning, acting and receiving feedback in the real world, representing a key pathway for AI to move from the digital realm into the physical world. Vision-based physical AI systems powered by large AI models need to convert visual information from real-world environments into tokens that can be processed by AI models before feeding these tokens into Transformers for subsequent tasks.
In traditional visual perception pipelines, light signals must go through multiple stages, including image sensing, analog-to-digital conversion, data buffering and transfer, digital image patching and embedding, before being transformed into tokens that AI models can process. The frequent transfer of massive amounts of redundant data has resulted in high energy consumption at the edge, according to a report by Science and Technology Daily.
The LightTok chip directly addresses a key challenge in physical AI hardware: how to efficiently acquire and tokenize visual information from the physical world with low energy consumption, Miao said.
The LightTok chip consists of a photosensitive memory array and peripheral circuits. The team built the array based on single-layer molybdenum disulfide (MoS₂) floating-gate phototransistors, with each pixel capable of sensing light, storing information and performing analog computing. By processing optical information directly within the chip, the device can convert captured visual signals into tokens for AI models, according to the research team.
The current LightTok prototype has a resolution of 32×32 pixels, or 1,024 photosensitive pixels, which is still smaller than that of smartphone cameras and industrial imaging systems. However, Miao said the technology is compatible with CMOS manufacturing processes and can be scaled up. With wafer-level growth of molybdenum disulfide materials, the chip could potentially achieve a scale comparable to existing imaging devices.
Miao said the chip also draws inspiration from the information-processing mechanism of human vision. Similar to how the retina extracts key visual information before transmitting it to the brain, the chip also aims to process visual information at an early stage.
The research was conducted in collaboration with another research team from the National University of Singapore. The findings were published on Wednesday in Nature Sensors, an internationally renowned journal in the field of sensing technology, according to the release.
Potential applications for LightTok include drone systems, autonomous remote sensing and small-scale embodied AI systems, Miao said. In these scenarios, devices need to continuously detect, understand and track targets, generating massive amounts of visual data. By reducing the energy required for visual processing, the technology could extend the operating time of drones, satellites and small robots with limited power supplies, the expert said.
。 Dhaka, Oct 9 (UNI) The holy Eid-e-Miladunnabi, marking the birth anniversary of Prophet Muhammad (peace be upon him), was observed in the country on Sunday with due religious fervor and festivity.
In separate messages, President M Abdul Hamid and Prime Minister Sheikh Hasina greeted the countrymen and the Muslims across the world on the occasion of the holy Eid-e-Miladunnabi.
Thousands of Muslims with banners of different spiritual and social organizations like the Maizbhandar Darbar and other spiritual hubs joined colourful street marches in the capital Dhaka and elsewhere in the country highlighting the Prophet's teachings of universal peace and harmony.
On this day in 570 - the 12th of Rabiul Awal of the Hijri calendar - Hazrat Muhammad (PBUH) was born in Mecca, Saudi Arabia with divine blessings and messages of peace for mankind.
Different government and non-government organizations including the Islamic Foundation (IF) chalked out elaborate programmes to mark the day.
Marking the day, Islamic Foundation (IF) took a 15-day programme at the Baitul Mukarram National Mosque in the city which began on Saturday.
State Minister for Religious Affairs Md Faridul Haque Khan inaugurated the 15-day programme at the Baitul Mukarram National Mosque in the city.
The programmes include religious sermons, doa mahfi and milad, seminars, exhibition of Islamic calligraphy and posters based on the life of the Prophet Hazrat Muhammad (PBUH), Islamic cultural competitions, and recitation of the holy Quran and poems on him.
He also inaugurated a month-long Islamic book fair at the south chattar of Baitul Mukarram National Mosque.
Some 50 Islamic missions and seven imam training academies have also chalked out various programmes marking the day.
Besides, Qurankhwani, doa mahfil and special prayers were held at different mosques in the city.
Qurankhwani, doa mahfil and special prayers were also held at the Mausoleum of Father of the Nation Bangabandhu Sheikh Mujibur Rahman at Tungipara in Gopalganj district, marking the day.
The spiritual hub of Maizbhandar also took various programmes to mark the day.
Tens of thousands of people thronged the capital’s Suhrawardy Udyan as the spiritual hub of Mazbhandar Darbar staged a massive rally to celebrate the birth anniversary of Prophet Mohammad (PBUH) - Eid-e-Miladunnabi with a spirit of inclusiveness and religious festivity.
Ministers, politicians across party lines and foreign Islamic and Sufi scholars alongside Bangladeshi ones addressed the rally analyzing holy Prophet’s (PBUH) teachings and ideals and Quranic principles and messages describing him as the blessings for the mankind, transcending the followers of Islamic faith or Muslims alone.
Incumbent leader of Mazibhandar Darbar Syed Saifudding Ahmed Maizbhandari chaired the rally, preceded by a colourful street march, when the devotees chanted hymns praising Allah and his Prophet (PBUH).
Senior Awami League leaders Amir Hossain Amu, Information and Broadcasting Minister Hassan Mahmud, Liberation War Affairs Minister AKM Mozammel Haque, Kalyan Party chairman major general (retd) Syed Mohammad Ibrahim, Islamic Shashantantra Andolon leader Misbahur Rahman were, among others, the political figures who spoke on the occasion.
Foreign spiritual figures from the United States, Morocco, Turkey and India spoke at the rally highlighting the Prophet Mohammmad’s (PBUH) role as the binding factor of the diversified human society as well as the symbol of peace and harmony in worldly life and as the means to secure divine blessings and height in spiritual realm.
The traditional colourful rallies 'Jasne Julush' under the auspices of different organizations including Anjuman-E-Rahmania Mainia Maizbhandaria were brought out in the city.
A massive rally was held in the capital's Mirpur area while a discussion titled 'Equality and Harmony in Islam' and a doa-mahfil were arranged at the Jahur Hossain Chowdhury auditorium of Jatiya Press Club (JPC).
State Minister for Religious Affairs Md Faridul Haque Khan was present as the chief guest there with JPC President Farida Yasmin in the chair.
JPC executive committee member Ayub Bhuiyan conducted it while general secretary of the club Elias Khan gave welcome speech on the occasion.
Senior member of the club Syed Akhtar Yusuf also addressed the discussion, among others.
A seminar was organized under the initiative of Aashiqui Rahmania Moinia Shahidi Maizbhandari at Kazi Bashir Uddin Auditorium of Mahanagar Natyamanch in city's Gulistan area.
State Minister for Religious Affairs Md Faridul Haque Khan addressed the seminar as the chief guest with organization's religious leader Shah Sufi Maulana Syed Shaheed Uddin Ahmad Maizbhandari in the chair.
Marking the day, Bangladesh Television (BTV) and Bangladesh Betar aired special programmes and different national dailies published supplements highlighting the importance of the day.
UNI MAZ SHK2206。
Current article:http://9talg.nenyaogecebenliexi.shop/fnbqd9f/20260826/4129.html
Published on:08:43:31
