With the development of communication networks and Artificial Intelligence (AI) technologies, Digital Twin (DT) now emerges to support various applications such as engineering, monitoring, controlling, healthcare and the optimization of cyber-physical systems. There is an increasing demand to create DTs that can represent physical entities for improving operational efficiency. A conventional DT consists of monitoring, imitation, and feedback control. However, conventional DTs cannot ensure efficient real-time imitation due to the high dynamics of physical systems such as UAV-based target tracking scenario. To address this issue, we propose a federated DT framework to support the imitation of mobile systems. It can guarantee real-time and accurate imitations under the prerequisite of comprehensive information acquired by a cooperative collection algorithm with the aid of UAVs. The framework can rapidly aggregate local DT models using an attention-based mechanism to improve mobile imitation accuracy. Additionally, we propose a multimodal-based DT inspection algorithm that can correct the postures of UAVs affected by winds for reliable imitations. We implement the framework in Gazebo. Our system simulations demonstrate the efficiency of the proposed federated DT framework. Our solution can reduce the imitation latency by an average of 68.4%, meanwhile, can improve the imitation accuracy by 16.4% on average when compared to traditional centralized and distributed imitation schemes.

@en

Federated Learning (FL) is an important privacy-preserving learning paradigm that plays an important role in the Intelligent Internet of Things. Training a global model in FL, however, is vulnerable to the data noise across the clients. In this paper, we introduce FedTrans, a novel client-transparent client utility estimation method designed to guide client selection for noisy scenarios, mitigating performance degradation problems. To estimate the client utility, we propose a Bayesian framework that models client utility and its relationships with the weight parameters and the performance of local models. We then introduce a variational inference algorithm to effectively infer client utility at the FL server, given only a small amount of auxiliary data. Our evaluation results demonstrate that leveraging FedTrans to select the clients can improve the accuracy performance (up to 7.8%), ensuring the robustness of FL in noisy scenarios.

@en

Visible light positioning (VLP) based on the received signal strength (RSS) can leverage a dense deployment of LEDs in future lighting infrastructure to provide accurate and energy-efficient indoor positioning. However, its positioning accuracy heavily depends on the density of collected fingerprints, which is labor-intensive. In this work, we propose a data pre-processing method, including data cleaning and data augmentation, to construct reliable and dense fingerprint samples, thereby alleviating the impact of noisy samples as well as reducing labor intensity. Extensive experiments demonstrate that our proposed method achieves an average positioning error of 1.7 cm, utilizing a sparse dataset that reduces the fingerprint collection effort by 98 percent. Running a tinyML-based model for VLP on the Arduino Nano microcontroller, we also show the possibilities for deploying RSS fingerprint-based VLP systems on resource-constrained embedded devices for real-world applications.

@en

Federated Learning (FL) has emerged as a privacy-preserving paradigm for collaborative deep learning model training across distributed data silos. Despite its importance, FL faces challenges such as high latency and less effective global models. In this paper, we propose ShuffleFL, an innovative framework stemming from the hierarchical FL, which introduces a user layer between the FL devices and the FL server. ShuffleFL naturally groups devices based on their affiliations, e.g., belonging to the same user, to ease the strict privacy restriction-"data at the FL devices cannot be shared with others", thereby enabling the exchange of local samples among them. The user layer assumes a multi-faceted role, not just aggregating local updates but also coordinating data shuffling within affiliated devices. We formulate this data shuffling as an optimization problem, detailing our objectives to align local data closely with device computing capabilities and to ensure a more balanced data distribution at the intra-user devices. Through extensive experiments using realistic device profiles and five non-IID datasets, we demonstrate that ShuffleFL can improve inference accuracy by 2.81% to 7.85% and speed up the convergence by 4.11x to 36.56x when reaching the target accuracy.@en

This paper presents a novel transparent amplifying intelligent surface (TAIS) architecture for uplink enhancement in indoor-To-outdoor mmWave communications. The TAIS is an amplifier-based transmissive intelligent surface that can refract and amplify the incident signal, instead of only refracting it with adjustable phase shift by most passive reconfigurable intelligent surfaces (RIS). With advanced indium tin oxide film and printing technology, TAIS can be fabricated on the windows without any visual effects. This paper primarily focuses on exploiting the TAIS-based architecture to boost the uplink spectral efficiency (SE) in indoor-To-outdoor mmWave communications. By jointly optimizing the TAIS's phase shift matrix and transmit power of the user equipment, the uplink SE can be maximized by exploiting the nonlinearity in the TAIS's amplification process. The key enabler is that we drive the optimal phase shift matrix that maximizes the SE and deduces its closed-form representation. The SE maximization is then proved to be transferred to the transmit power optimization problem. Another important enabler is that we design a low-complexity algorithm to solve the optimization problem using the difference of convex programming. Moreover, the asymptotic spectral efficiency under nonlinear amplification and power scaling law with infinitely large elements under both the sparse and rich scattering channel models are analyzed. Simulation results show that our proposed TAIS can increase the SE by up to 24.7% as compared to its alternative methods.

@en

This paper presents a novel transparent amplifying intelligent surface (TAIS) architecture for uplink enhancement in indoor-to-outdoor mmWave communications. The TAIS is an amplifier-based transmissive intelligent surface that can refract and amplify the incident signal, instead of only refracting it with adjustable phase shift by most passive reconfigurable intelligent surfaces (RIS). With advanced indium tin oxide film and printing technology, TAIS can be fabricated on the windows without any visual effects. This paper primarily focuses on exploiting the TAIS-based architecture to boost the uplink spectral efficiency (SE) in indoor-to-outdoor mmWave communications. By jointly optimizing the TAIS's phase shift matrix and transmit power of the user equipment, the uplink SE can be maximized by exploiting the nonlinearity in the TAIS's amplification process. The key point is that we drive the optimal phase shift matrix that maximizes the SE and deduces its closed-form representation. The SE maximization is then proved to be transferred to the transmit power optimization problem. Another important aspect is that we design a low-complexity algorithm to solve the problem using the difference of convex programming. Simulations show that our proposed TAIS can increase the SE by up to 32.6% as compared to its alternative methods.@en

The development of the intelligent Internet of Things has facilitated the adoption of high-efficiency Multiple Targets Tracking (MTT) in many civil security applications. However, existing MTT technologies cannot offer full capability in accurate and real-time MTT for civil security. Many attractive applications in the next-generation wireless network, like Unmanned Aerial Vehicle (UAV) swarm, are envisioned to be exploited for enhanced MTT with the advantage of flexibility. Nonetheless, highly dynamic moving targets impose some new challenges. UAVs cannot always perform expected cooperative tracking in conventional architectures as well. To address these problems, we design a tiered Digital Twin-assisted tracking framework in this paper, which leverages multi-grained imitation for real-time and accurate MTT. We imitate a coarse-grained MTT to ensure a high successful tracking ratio. We then design a fine-grained imitation with a reaction-diffusion mechanism to explore the feasible cooperators based on trajectory prediction. Hardware-in-the-loop simulations demonstrate that our tiered framework can reduce 66.7% of the system latency overhead compared to the conventional DDPG benchmark while improving the successful tracking ratio by 30.6%.

@en

Radio-Frequency (RF) backscatter has emerged as a low-power communication technique. Backscatter systems either rely on active signal generators (spectrum efficient, but dedicated infrastructure) or existing ambient wireless transmissions (existing infrastructure, but spectrum inefficient). In this paper, we aim to make RF backscatter spectrum efficient and at the same time work with existing infrastructure. We propose to leverage the deployment of LiFi networks built upon LED bulbs for pervasive RF backscatter. We experimentally demonstrate that LiFi, which passively leaks RF signals, can be exploited as a radio carrier generator for low-power RF backscatter. We further design LeakageScatter, the first backscatter system operating in the ISM band and exploiting LiFi-leaked RF signals, without the need to actively generate the carrier wave. We customize the design of the loop at the LiFi transmitter, as well as the coil antennas at the tag and RF backscatter receiver, to optimize the system performance. We propose to opportunistically enable the oscillator of the backscatter tag in the software that could reduce the energy consumption on backscattering by up to 75%. Experimental results show that LeakageScatter achieves a backscattering distance up to 10 m and 18 m in indoor and outdoor scenarios, respectively, without using a dedicated RF carrier generator.

@en

This paper studies a promising use case of a private 5G network for the sports industry: wearable bodycams and sensors in a football match. This use case requires a reliable and dedicated massive MIMO network to provide uniform coverage with a high capacity in the whole pitch area. The coverage of co-located and distributed (cell-free) massive MIMO, differing in the configuration of base station antenna placement inside the stadium, are evaluated through ray tracing using a 3D stadium model and players' mobility dataset. The results give insight into how distributed antennas inside the stadium should be deployed to enhance the uniform coverage of moving wearable devices. Besides that, the uplink capacity performance and the impact of channel aging on the capacity are also evaluated. The results demonstrate the advantages and disadvantages of different base station antenna distribution strategies in terms of coverage, capacity and channel aging impact.@en

Smartphones are moving towards the fullscreen design for better user experience. This trend forces front cameras to be placed under screen, leading to Under-Screen Cameras (USC). Accordingly, a small area of the screen is made translucent to allow light to reach the USC. In this paper, we utilize the translucent screen's features to inconspicuously modify its pixels, imperceptible to human eyes but inducing perturbations on USC images. These screen perturbations affect deep learning models in image classification and face recognition. They can be employed to protect user privacy, or disrupt the front camera's functionality in the malicious case. We design two methods, one-pixel perturbation and multiple-pixel perturbation, that can add screen perturbations to images captured by USC and successfully fool various deep learning models. Our evaluations, with three commercial full-screen smartphones on testbed datasets and synthesized datasets, show that screen perturbations significantly decrease the average image classification accuracy, dropping from 85% to only 14% for one-pixel perturbation and 5.5% for multiple-pixel perturbation. For face recognition, the average accuracy drops from 91% to merely 1.8% and 0.25%, respectively.@en

Cardiac patterns are being used to provide hard-to-forge biometric signatures in identification applications. However, this performance is obtained under controlled scenarios where cardiac signals maintain a relatively uniform pattern, facilitating the identification process. In this work, we analyze cardiac signals collected in more realistic (uncontrolled) scenarios and show that their high signal variability makes them harder to obtain stable and distinct features. When faced with these irregular signals, the state-of-the-art (SOTA) reduces its performance significantly. To solve these problems, we propose the CardioID framework¹ with two novel properties. First, we design an adaptive method that achieves stable and distinct features by tailoring the filtering process according to each user’s heart rate. Second, we show that users can have multiple cardiac morphologies, offering us a bigger pool of cardiac signals compared to the SOTA. Considering three uncontrolled datasets, our evaluation shows two main insights. First, while using a PPG sensor with healthy individuals, the SOTA’s balanced accuracy (BAC) reduces from 90–95% to 75–80%, while our method maintains a BAC above 90%. Second, under more challenging conditions (using smartphone cameras or monitoring unhealthy individuals), the SOTA’s BAC reduces to values between 65–75%, and our method increases the BAC to values between 75–85%.

@en

Federated Learning (FL) is an important privacy-preserving learning paradigm that is expected to play an essential role in the future Intelligent Internet of Things (IoT). However, model training in FL is vulnerable to noise and the statistical heterogeneity of local data across IoT clients. In this paper, we propose FedNaWi, a “Go Narrow, Then Wide” client selection method that speeds up the FL training, achieves higher model performance, while requiring no additional data or sensitive information transfer from clients. Our method first selects reliable clients (i.e., going narrow) which allows the global model to quickly improve its performance and then includes less reliable clients (i.e., going wide) to exploit more IoT data of clients to further improve the global model. To profile client utility, we introduce a unified Bayesian framework to model the client utility at the FL server, assisted by a small amount of auxiliary data. We conduct extensive evaluations with 5 state-of-the-art FL methods, on 3 IoT tasks and under 7 different types of label and feature noise. We build an FL testbed with 38 IoT nodes (20 nodes run on Raspberry Pi 4B and 18 nodes run on Jetson Nano) for the evaluation. Our results show that FedNaWi improves the FL accuracy substantially and significantly reduces energy consumption. In particular, FedNaWi improves the accuracy from 35% to 75% in the non-IID Dirichlet setting, and reduces the average energy consumption by 55%.@en

Visible Light Communication (VLC) is widely considered a promising technology for the coming 6G networks. Recent studies show that a VLC transmitter not only emits visible light signals but also leaks RF signals during the transmission. In this work, we devote effort to harvesting the free leaked RF energy from VLC transmissions. We observe that the surrounding objects could help a coil antenna harvest significantly more RF energy. Based on this observation, we propose our system Bracelet+, which involves the human body in the harvesting system to increase the harvested power. After careful analysis of the influence of the human body on the harvested power, we prototype the coil antenna as a bracelet that achieves both high harvested power and convenience for wearing. The average power of the RF energy harvested by our design is 10 larger than that of the conventional coil antenna, without causing any interference to the communication of VLC systems. The harvested power can reach up to micro-watts in our tested scenarios. Such a micro-watt level of harvested energy has the potential to power up ultra-low-power sensors such as temperature sensors and glucose sensors.@en

Various interconnected Internet of Things (IoT) devices have emerged, led by the intelligence of the IoT, to realize exceptional interaction with the physical world. In this context, UAV swarm-enabled Multiple Targets Tracking (UAV-MTT), which can sense and track mobile targets for many applications such as hit-and-run, is an appealing topic. Unfortunately, UAVs cannot implement real-time MTT based on the traditional centralized pattern due to the complicated road network environment. It is also challenging to realize low-overhead UAV swarm cooperation in a distributed architecture for the real-time MTT. To address the problem, we propose a cyber-twin-based distributed tracking algorithm to update and optimize a trained digital model for real-time MTT. We then design a distributed cooperative tracking framework to promote MTT performance. In the design, both short-distance and long-distance distributed tracking cooperation manners are first realized with low energy consumption in communication by integrating resources of sensing and communication. Resource integration promotes target sensing efficiency with a highly successful tracking ratio as well. Theoretical derivation proves our algorithmic convergence. Hardware-in-the-loop simulation results demonstrate that our proposed algorithm can remarkably save 65.7% energy consumption in communication compared to other benchmarks while efficiently promoting 20.0% sensing performance.

@en

Visible Light Communication (VLC) has emerged in the last few years as a promising technology not only for high-speed communication but also for serving a new generation of Internet of Things (IoT) devices that may leverage the pervasive lighting infrastructures. Integrating VLC in lighting environments for IoT requires the design of networked and intelligent luminaries and new IoT devices, encompassing the development of innovative technologies and new algorithms. A common experimental platform is necessary to lower the entrance barriers of VLC and speed up the research development. In this article, we provide guidelines for prototyping VLC for IoT applications, assisted by the open-source platform OpenVLC. We also introduce the new development on OpenVLC, which guarantees support for more powerful LEDs and much longer distance (extending the communication distance from 6 m to 19 m), dimming adaption, among other features. Its low-cost, open-source, and open-hardware designs allow researchers in the community to swiftly adapt it to suit their research purposes.

@en

Visible Light Positioning (VLP) has been prevalent in providing high-precision localization systems in the past decade. However, the commercial availability or usage is still limited primarily due to the requirement of changing the existing lighting infrastructure. In this paper, we propose HueSense, an alternative technique to develop a passive VLP system by extracting light-emission intrinsic features, such as dominant colours present in the white LED light. The method can eliminate the need to change lighting-infrastructure, and only uses cheaper and power-efficient off-the-shelf hue sensors. Our experiments demonstrate that HueSense can achieve a location-mapping accuracy of 80.14% with a moving robot in uncontrolled lighting environments.@en

While radio communication still dominates in 5G, light and radios are expected to complement each other in the coming 6G networks. Visible Light Communication (VLC) is therefore attracting a tremendous amount of attention from both academia and industry. Recent studies showed that the front camera of pervasive smartphones is an ideal candidate to serve as the VLC receiver. While promising, we observe a recent trend with smartphones that can greatly hinder the adoption of smartphones for VLC, i.e., smartphones are moving towards full-screen for the best user experience. This trend forces front cameras to be placed under the devices' screen - -leading to the so-called Under-Screen Camera (USC) - -but we observe a severe performance degradation in VLC with USC: the transmission range is reduced from a few meters to merely 0.04 m, and the throughput is decreased by more than 90%. To address this issue, we leverage the unique spatiotemporal characteristics of the rolling shutter effect on USC to design a pixel-sweeping algorithm to identify the sampling points with minimal interference from the translucent screen. We further propose a novel slope-boosting demodulation method to deal with color shift brought by the leakage interference. We build a proof-of-concept prototype using two commercial smart-phones. Experiment results show that our proposed design reduces the BER by two orders of magnitude on average and improves the data rate by 59×: from 914 b/s to 54.43 kb/s. The transmission range is extended by roughly 100×: from 0.04 m to 4.2 m.

@en

To protect sensitive information on smartphones, state-of-the-art (SoA) studies exploit the built-in camera to capture PPG signals from fingertips as a hard-to-forge biometric. However, those studies do not provide a comprehensive analysis to optimize the camera parameters and finger pressure, leading to distorted and unstable PPG signals that degrade the authentication performance. To overcome these limitations, we propose the CamPressID framework. First, we analyze various camera parameters and optimize their configuration to obtain PPG signals with a high signal-to-noise ratio. Second, we investigate different finger pressures to identify the best pressure for every subject, in order to avoid signal distortion. To evaluate the performance of CamPressID, we collect a diverse dataset with 58 subjects. Our evaluation results show that CamPressID can improve the average balanced accuracy (BAC) by 10%. Moreover, the BAC reaches 90%, which is similar to the accuracy reported in the SoA using a dedicated PPG sensor for authentication.@en

Cardiac patterns are being used to obtain hard-to-forge biometric signatures and have led to high accuracy in state-of-the-art (SoA) identification applications. However, this performance is obtained under controlled scenarios where cardiac signals maintain a relatively uniform pattern, facilitating the identification process. In this work, we analyze cardiac signals collected in more realistic (uncontrolled) scenarios and show that their high signal variability (i.e., ir-regularity) makes it harder to obtain stable and distinct user features. Furthermore, SoA usually fails to identify specific groups of users, rendering existing identification methods futile in uncontrolled scenarios. To solve these problems, we propose a framework with three novel properties. First, we design an adaptive method that achieves stable and distinct features by tailoring the filtering spectrum to each user. Second, we show that users can have multiple cardiac morpholo-gies, offering us a much bigger pool of cardiac signals and users compared to SoA. Third, we overcome other distortion effects present in authentication applications with a multi-cluster approach and the Mahalanobis distance. Our evaluation shows that the average balanced accuracy (BAC) of SoA drops from above 90% in controlled scenarios to 75% in uncontrolled ones, while our method maintains an average BAC above 90% in uncontrolled scenarios.

@en

Touchscreens and buttons had became a medium for virus transmission during the COVID-19 pandemic. We have seen in our daily life that people use tissues and keys to press buttons inside elevators, on public screens, etc. In the post- COVID world, touch-free interaction with public touchscreens and buttons may become more popular. Motivated by the rise of visible light communication and sensing, we design a real-time embedded system to enable touch-free fingertip writing of the digits 0–9 with only ambient light and simple photodiodes. We propose an embedded deep learning model to learn the spatial and temporal patterns in the dynamic shadow for air-writing digits recognition. The model is devised with a lightweight convolutional architecture such that it can run on a resource-limited device. We evaluate our model using the LightDigit dataset [1] and report the results in terms of accuracy and inference time. @en