Jakov Dot Org - Home Page of Jacob Chakareski

Jacob Chakareski is an associate professor in the College of Computing at NJIT, where he holds the Panasonic Chair of Sustainability. His long-term vision is enabling ubiquitous networked immersion and virtual human teleportation to any remote corner of the world to assist humanity with societal challenges (see Figure). He synergistically explores NextG mobile multi-user virtual and augmented reality (XR) systems, millimeter wave and free-space optical wireless networking, physics-aware fast reinforcement learning for emerging IoT/XR systems/applications, mobile edge computing, UAV-IoT sensing and networking, and multi-connectivity enabled scalable 360° video streaming, in the pursuit of these objectives. He holistically explores four key system aspects of such next generation applications for immersive communication: data capture; coding and signal representation; ubiquitious mobile networking; and user navigation and content reconstruction. His investigations span analysis, optimization, and implementation of concepts and techniques from communications and networking, signal processing, and machine learning. His interests include 5G and IoT network architectures, cooperative edge computing and caching in small-cell networks, and biomedical applications.

Chakareski has been pursuing the development of a next generation VR+AI system for automated and broadly affordable/accessible low vision rehabilitation with NIH support. Recently, he studied the development of new immersive ways for experiencing classical music in the COVID era with NJSO support. Previously, he has eagerly explored advanced ultrasonic applications in telemedicine, remote sensing, and biomedicine; the integration of multi-view imaging and deep learning with novel cyber-physical health care devices and systems for automated obesity and food intake monitoring; and deep learning-enabled capsule endoscopy imaging for automated and high accuracy/low cost intestinal bleeding detection. Dr. Chakareski is passionate about bridging science and technology via entrepreneurial activity.

On the personal side, Chakareski has broad interests spanning anthropology, history, foreign languages, travelling, healthy living and exercising, diverse music genres, and sports in general.

Important announcement: I have broad openings in my group spanning graduate, postdoc, intern, and developer positions.

NEWS:
Aug. 2024: ACM Multimedia demo paper on ML-enabled scene graph driven hybrid multi-party interactive VR teleconferencing accepted.
July 2024: IEEE Globecom paper on AI-based joint communication/computation resource allocation for emerging mmWave multi-user 3D video streaming systems accepted.
July 2024: Thank you NSF for our new CNS project on multi-sensorial multi-site collaborative VR environments.
June 2024: IEEE MetaCom paper on experimental mmWave 360-Degree ABR Video Streaming evaluation accepted.
June 2024: Invited IEEE MIPR paper on AI-enhanced multi-task decision-making for multi-user 360 video processing over mmWave wireless networks.
May 2024: Second miVirtualSeat retreat at UIUC.
Apr. 2024: Invited to attend NJ AI Summit at Princeton.
Mar. 2024: Sigmetrics paper on near-optimal neural-enhanced streaming accepted.
Mar. 2024: IEEE TMM paper on live 360° video streaming in 5G networks accepted.
Feb. 2024: Invited participation/brief talk at IMMERSE symposium at UIUC.
Prior news

Select recent publications: (Please see Google Scholar for a comprehensive most up to date publication list. Please email me if you need a PDF of any of the papers below.)

L. Wang, S. Singh, J. Chakareski, M. Hajiesmaili, and R. Sitaraman, "BONES: Near-Optimal Neural-Enhanced Video Streaming", in Proc. ACM Sigmetrics/IFIP Performance, Jun. 2024.
J. Chakareski and M. Khan, "Live 360° video streaming to heterogeneous clients in 5G networks," IEEE Trans. Multimedia, Mar. 2024, accepted.
S. Singh and J. Chakareski, "Aerial 360° video delivery for immersive first person view UAV navigation," in Proc. IEEE ISM, Dec. 2023.
M. Wu,..., M. Zink, R. Sitaraman, J. Chakareski, and K. Nahrstedt, "Interactive scene graph analysis for future intelligent teleconferencing systems," in Proc. IEEE ISM, Dec. 2023.
S. Mahboob, K. Kar, J. Chakareski, and M. I. Alam, "CLoSER: Video caching in small-cell edge networks with local content sharing," Elsevier Computer Networks, Dec. 2023.
J. Chakareski, X. Corbillon, G. Simon, and V. Swaminathan, "User navigation modeling, rate-distortion analysis, and end-to-end optimization for viewport-driven 360° video streaming," IEEE Trans. Multimedia, Nov. 2023.
M. Naderi, J. Chakareski, and M. Ghanbari, "Hierarchical Q-learning-enabled neutrosophic AHP scheme in candidate relay set size adaption in vehicular networks," Elsevier Computer Networks, Nov. 2023
A. Omer, F. Malandra, J. Chakareski, and N. Mastronarde, "Performance evaluation of 5G delay-sensitive single carrier multi-user downlink scheduling," in Proc. IEEE PIMRC, Sept. 2023.
S. Srinivasan, S. Shippey, E. Aryafar, and J. Chakareski, "FBDT: Forward and backward data transmission across multiple RATs for high quality mobile VR 360° video streaming," in Proc. ACM MMSys, June 2023.
J. Chakareski, M. Khan, T. Ropitault, and S. Blandino, "Millimeter wave and free-space-optics for future dual-connectivity 6DOF mobile multi-user VR streaming," ACM TOMCCAP, Feb. 2023.
S. Gupta, J. Chakareski, and P. Popovski, "mmWave networking and edge computing for scalable 360° video multi-user virtual reality," IEEE Trans. Image Processing, Dec. 2022.
J. Chakareski, M. Khan, and M. Yuksel, "Towards enabling next generation societal virtual reality applications for virtual human teleportation," IEEE Signal Processing Magazine, Sept. 2022.
J. Sun, N. Sharma, J. Chakareski, N. Mastronarde, and Y. Lao, "Stochastic computing and hardware acceleration for post-decision state reinforcement learning in IoT systems," IEEE IoT Journal, June 2022.
A. Rovira-Sugranes, A. Razi, F. Afghah, and J. Chakareski, "A review of AI-enabled routing protocols for UAV networks: Trends, challenges, and future outlook," Elsevier Ad Hoc Networks, May 2022.
L. Zhang and J. Chakareski, "UAV-assisted edge computing and streaming for wireless virtual reality: Analysis, algorithm design, and performance guarantees," IEEE Trans. Vehicular Technology, Mar. 2022.
N. Mastronarde, N. Sharma, and J. Chakareski, "Improving data-driven reinforcement learning in wireless IoT systems using domain knowledge," IEEE Communications Magazine, Nov. 2021.

Major awards & distinctions:

NSF CCF-1528030, ECCS-1711592.
NSF CNS-1821875, CNS-1836909.
NSF CNS-1836909, NIH R01EY030470.
IEEE TMM Associate Editor 2024-2027
Best Workshop Paper Award ACM MMSys 2021
Best Paper Award ACM CFI 2019
Adobe Data Science Faculty Research Award 2018
Adobe Data Science Faculty Research Award 2017
Best paper award IEEE ICC 2017
US AFOSR Faculty Fellow 2015-2016
IEEE Senior Member
First Laundry Assistant to Phil Chou ;-) [an all-time award]
Swiss NSF Ambizione Career Award 2009

Recent service:

Organizer: IEEE WowMoM SwarmNet Workshop (June 2019/20/21)
Organizer: NSF Future VR/AR Network Workshop (April 2018)
Organizer: CPC-UAV Workshop @ IEEE SECON 2018
Organizer: SS Immersive VR/AR Experiences @ ACM MMSys 2017
Guest editor: IEEE TCSVT SI Mobile Visual Cloud (January 2017)
TP chair: IEEE Packet Video AR Workshop 2016
Demo/Expo chair: IEEE ICME 2016

Tech involvement:

Frame: The network is your computer. [The future is here: Personalized cloud apps for everyone.] Nutanix Announces Intent to Acquire Frame.
Vidyocast: Scalable (SVC) video telepresence and IP broadcast. [An industry's first.] Enghouse Systems Acquires Vidyo, Inc.