Monday, December 21, 2020

Computational Imaging and Microscopy



This is an excellent talk, and takes one of the most complex subjects and breaks it down simply from the beginning.  


     14:38 in to the video. 

  It took be the better part of 25 years to learn the secret of zooming in to a license plate from an impossibly Zoomed image.  Something that when shown in Sci-Fi TV shows in the 70's and 80's - 90's...  I just assumed was Bullshit.  

 I eventually learned the secret from one of the top digital imaging experts that's I've known 25 years, and well after his retirement.  He implemented it on super top secret hardware for satellite imaging, when I was still in grade school.  It used the fact that every pixel in your image represents a sine cardinal from the whole image.  Also known as Sinc function it is the continuous inverse Fourier transform of a rectangular pulse and can be thought of a Gaussian modulated sine wave, although I am not really sure if these are the exact equivalent though I see it implemented in RF applications like this. 
In his case the Lens had to be extremely well understood, and in the end it generated convolution filters that were able to be ran quickly and efficiently. 

What is interesting is to see this generalized in to a generic computational imaging problem.  It may actually yield better results with more information, but most likely will be much more computation. 





Computational imaging involves the joint design of imaging system hardware and software, optimizing across the entire pipeline from acquisition to reconstruction. This talk will describe new methods for computational microscopy with coded illumination, based on a simple and inexpensive hardware modification of a commercial microscope. Traditionally, one must trade field-of-view for resolution; with our methods we can have both, resulting in Gigapixel-scale images with resolution beyond the diffraction limit of the system. Our reconstruction algorithms are based on large-scale nonlinear non-convex optimization procedures for phase retrieval. Laura Waller leads the Computational Imaging Lab, which develops new methods for optical imaging, with optics and computational algorithms designed jointly. She holds the Ted Van Duzer Endowed Professorship and is a Senior Fellow at the Berkeley Institute of Data Science (BIDS), with affiliations in Bioengineering and Applied Sciences & Technology. Laura was a Postdoctoral Researcher and Lecturer of Physics at Princeton University from 2010-2012 and received BS, MEng and PhD degrees from MIT in 2014, 2015 and 2010, respectively. She is a Moore Foundation Data-Driven Investigator, Bakar fellow, Distinguished Graduate Student Mentoring awardee, NSF CAREER awardee and Packard Fellow.

Tuesday, December 15, 2020

Transmit a video stream to a PAL analog TV using low-frequency PWM

 



Uses STM32F411 a slow 6.86MHz PWM output to generate modulated transmitting output and the 9th harmonic is 61.71MHz (it is picked up on channel 3 of the TV).

https://hackaday.io/project/171977-pal-streamer

https://github.com/zst123/PAL-Streamer






He used an AVR ATTiny85 to generate PWM waveforms which were picked up by his TV.

https://hackaday.io/project/4348-attiny85-does-ntsc-over-vhf

Thursday, December 10, 2020

A camera that can look inside the keyhole to read the keys pattern!!




Currently $345 USD

The LockTech LTKS KwikSet Decoder is a WIFI enabled digital scope that when used with a compatible IOS or Android Smartphone makes decoding these locks ridiculously easy and fast!

Features:
- Decodes all current SmartKey locks (GEN 1, 2, 3, & 4) and SmartKey Control Key cylinders as well.
- A real glass mirror for the clearest image possible.
- Internal LED eliminates glare off the front of the lock.
- Position Alignment Spacers eliminate the guesswork of where you're looking at in the lock and locating individual wafers/pins during the decoding process.
- LED dimmer allows the user to increase or decrease the brightness inside of the lock.
- Live Video Display Feed, SnapShot Mode, or Video Mode.
- Rechargeable battery
- Magnetic Protective Storage Cap
- Spacers, Protective Cap, and Laminated Depth Chart are tethered for convenience.

 System requirement:

Android 4.2 and iOS 8.0 or later


https://www.internationalkeysupply.com/products/locktech-ltks-wi-fi-enabled-decoder-for-kwikset-smartkey-locks

Saturday, December 05, 2020

Thursday, October 29, 2020

Watch "The First Live Light Field Videocamera | SEBI" on YouTube

https://youtu.be/hiYc8iRK-Ok 

Wooptix say their SEBI development kit for their liquid lens "light field" camera is available now -- camera alone, or with LookingGlass display etc. Any ideas of prices, expertise level needed?
"The development kit contains the SEBI camera, a high speed liquid lens, a FPGA lens controller synchronizing the liquid lens and the image sensor, two camera link cables for data transfer and a PC for live algorithm processing using Wooptix' proprietary software. Using the SEBI software, the camera can acquire either snapshots or video sequences, obtaining an all-in-focus image and a corresponding depth map for each image frame"


Thursday, October 22, 2020

Wednesday, September 23, 2020

Facebook: Video@Scale 2020

https://videoscale2020.splashthat.com/

OCTOBER 22, 2020

10:00AM – 1:00PM

REGISTER NOW

YOU'RE INVITED TO VIDEO @SCALE REMOTE EDITION


BUILDING DISTRIBUTED VIDEO SYSTEMS




Video @Scale is an invitation-only technical conference for engineers that develop or manage large-scale video systems serving millions of people. The development of large-scale video systems includes complex, unprecedented engineering challenges. The @Scale community focuses on bringing people together to discuss these challenges and collaborate on the development of new solutions.


 


This year, we will be hosting our Video @Scale event virtually. 




 


AGENDA


SESSION #1


VIDEO QUALITY


10:00 AM - 11:00 AM PST






 






KEYNOTE


    Rajeev Rajan


VIDEO CODING STANDARDIZATION


     Ioannis Katsavounidis


VIDEO ENCODING PARAMETER SELECTION WITH HYBRID SOFTWARE/HARDWARE APPROACH


     Nick Wu


VMAF


     Zhi Li | Netflix


SESSION #2


SCALABILITY & RELIABILITY


11:00 AM - 12:00 PM PST




YET ANOTHER LIVE VIDEO DELIVERY ARCHITECTURE


     Kirill Pugin


SCALING I/O TO MILLIONS OF VIDEOS


     David Zhang


PROVIDING BETTER VIDEO EXPERIENCE FOR THE NEXT BILLION USERS


     Denise Noyes


BYTES RANGE ADDRESSING WITH LL-HLS


     Will Law | Akamai


SESSION #3 


PANEL + Q&A 


12:00 PM - 1:00 PM PST




VIDEO TRENDS DURING COVID-19


     Jaron Schaeffer | Google


     Connie Goshgarian | AT&T


     Li-Tal Mashiach | Facebook 


     Tremain Wheatley | Facebook (Moderator)


 


 

Tuesday, September 22, 2020

Engineers produce a fisheye lens that’s completely flat

Engineers produce a fisheye lens that’s completely flat

The single piece of glass produces crisp panoramic images.

https://news.mit.edu/2020/flat-fisheye-lens-0918

To capture panoramic views in a single shot, photographers typically use fisheye lenses — ultra-wide-angle lenses made from multiple pieces of curved glass, which distort incoming light to produce wide, bubble-like images. Their spherical, multipiece design makes fisheye lenses inherently bulky and often costly to produce.


Now engineers at MIT and the University of Massachusetts at Lowell have designed a wide-angle lens that is completely flat. It is the first flat fisheye lens to produce crisp, 180-degree panoramic images. The design is a type of “metalens,” a wafer-thin material patterned with microscopic features that work together to manipulate light in a specific way.


In this case, the new fisheye lens consists of a single flat, millimeter-thin piece of glass covered on one side with tiny structures that precisely scatter incoming light to produce panoramic images, just as a conventional curved, multielement fisheye lens assembly would. The lens works in the infrared part of the spectrum, but the researchers say it could be modified to capture images using visible light as well.


The new design could potentially be adapted for a range of applications, with thin, ultra-wide-angle lenses built directly into smartphones and laptops, rather than physically attached as bulky add-ons. The low-profile lenses might also be integrated into medical imaging devices such as endoscopes, as well as in virtual reality glasses, wearable electronics, and other computer vision devices.


“This design comes as somewhat of a surprise, because some have thought it would be impossible to make a metalens with an ultra-wide-field view,” says Juejun Hu, associate professor in MIT’s Department of Materials Science and Engineering. “The fact that this can actually realize fisheye images is completely outside expectation.


This isn’t just light-bending — it’s mind-bending.”


Hu and his colleagues have published their results today in the journal Nano Letters. Hu’s MIT coauthors are Mikhail Shalaginov, Fan Yang, Peter Su, Dominika Lyzwa, Anuradha Agarwal, and Tian Gu, along with Sensong An and Hualiang Zhang of UMass Lowell.


Video thumbnailPlay video

Design on the back side


Metalenses, while still largely at an experimental stage, have the potential to significantly reshape the field of optics. Previously, scientists have designed metalenses that produce high-resolution and relatively wide-angle images of up to 60 degrees. To expand the field of view further would traditionally require additional optical components to correct for aberrations, or blurriness — a workaround that would add bulk to a metalens design.


Hu and his colleagues instead came up with a simple design that does not require additional components and keeps a minimum element count. Their new metalens is a single transparent piece made from calcium fluoride with a thin film of lead telluride deposited on one side. The team then used lithographic techniques to carve a pattern of optical structures into the film.


Each structure, or “meta-atom,” as the team refers to them, is shaped into one of several nanoscale geometries, such as a rectangular or a bone-shaped configuration, that refracts light in a specific way. For instance, light may take longer to scatter, or propagate off one shape versus another — a phenomenon known as phase delay.


In conventional fisheye lenses, the curvature of the glass naturally creates a distribution of phase delays that ultimately produces a panoramic image. The team determined the corresponding pattern of meta-atoms and carved this pattern into the back side of the flat glass.


‘We’ve designed the back side structures in such a way that each part can produce a perfect focus,” Hu says.


On the front side, the team placed an optical aperture, or opening for light.


“When light comes in through this aperture, it will refract at the first surface of the glass, and then will get angularly dispersed,” Shalaginov explains. “The light will then hit different parts of the backside, from different and yet continuous angles. As long as you design the back side properly, you can be sure to achieve high-quality imaging across the entire panoramic view.”


Across the panorama


In one demonstration, the new lens is tuned to operate in the mid-infrared region of the spectrum. The team used the imaging setup equipped with the metalens to snap pictures of a striped target. They then compared the quality of pictures taken at various angles across the scene, and found the new lens produced images of the stripes that were crisp and clear, even at the edges of the camera’s view, spanning nearly 180 degrees.


“It shows we can achieve perfect imaging performance across almost the whole 180-degree view, using our methods,” Gu says.


In another study, the team designed the metalens to operate at a near-infrared wavelength using amorphous silicon nanoposts as the meta-atoms. They plugged the metalens into a simulation used to test imaging instruments. Next, they fed the simulation a scene of Paris, composed of black and white images stitched together to make a panoramic view. They then ran the simulation to see what kind of image the new lens would produce.


“The key question was, does the lens cover the entire field of view? And we see that it captures everything across the panorama,” Gu says. “You can see buildings and people, and the resolution is very good, regardless of whether you’re looking at the center or the edges.”


The team says the new lens can be adapted to other wavelengths of light. To make a similar flat fisheye lens for visible light, for instance, Hu says the optical features may have to be made smaller than they are now, to better refract that particular range of wavelengths. The lens material would also have to change. But the general architecture that the team has designed would remain the same.


The researchers are exploring applications for their new lens, not just as compact fisheye cameras, but also as panoramic projectors, as well as depth sensors built directly into smartphones, laptops, and wearable devices.


“Currently, all 3D sensors have a limited field of view, which is why when you put your face away from your smartphone, it won’t recognize you,” Gu says. “What we have here is a new 3D sensor that enables panoramic depth profiling, which could be useful for consumer electronic devices.”


This research was funded in part by DARPA under the EXTREME Program.

World's largest camera sensor snaps first ever 3,200-megapixel photos

Saturday, September 19, 2020

Tuesday, September 01, 2020

500'000€ Prize for Compressing Human Knowledge

500'000€ Prize for Compressing Human Knowledge

http://prize.hutter1.net/

The Task

Losslessly compress the 1GB file enwik9 to less than 116MB. More precisely:
  • Create a Linux or Windows compressor comp.exe of size S1 that compresses enwik9 to archive.exe of size S2 such that S:=S1+S2 < L := 116'673'681 = previous record.
  • If run, archive.exe produces (without input from other sources) a 109 byte file that is identical to enwik9.
  • If we can verify your claim, you are eligible for a prize of 500'000€×(1-S/L). Minimum claim is 5'000€ (1% improvement).
  • Restrictions: Must run in ≲100 hours using a single CPU core and <10gb a="" and="" class="extern" hdd="" href="http://browser.primatelabs.com/v4/cpu/145066" nbsp="" on="" our="" ram="" style="color: black;">test machine
.

Friday, August 21, 2020

Glenn Weiss live-switched the entire DNC convention from his house.


Alex Lightman on Facebook Said:

How to make yourself highly employable 1 of 100

This is Glenn Weiss. He live-switched the entire DNC convention from his house.

Note to self: learn to live-switch. Seems like a useful and highly scalable skill.

I have the video equipment. Now I just need a convention or something with important people saying impressive things in inspiring ways and I’m gtg.





Wednesday, August 19, 2020

PJSIP is an Open Source Embedded SIP protocol stack written in C.

PJSIP

PJSIP is an Open Source Embedded SIP protocol stack written in C.
The development of PJSIP is mainly focused on having a small footprint, modular, and very portable SIP stack for embedded development purposes (although it’s perfectly good for Win32/Linux/MacOS as well). Some of the characteristics of PJSIP:
  • it is built on top of PJLIB, and since PJLIB is a very very portable library, basically PJSIP can run on any platforms where PJLIB is ported (including platforms where normally it would be hard to port existing programs to, such as Symbian and some custom OSes).
  • it has quite a small footprint, although probably it’s not the smallest SIP stack on the planet (the smallest SIP stack would be a stack that does nothing!),
  • it is quite customizable and modular, meaning that features that are not needed won’t get linked into the executable,
  • it has pretty good performance (thousands of calls per second), and
  • it has quite a lot of SIP features.
A high-level SIP multimedia user agent API is available for both C and Python language.

Links



https://www.pjsip.org/

https://github.com/pjsip/pjproject


New: Video codec VP8 & VP9!

PJSIP is a free and open source multimedia communication library written in C language implementing standard based protocols such as SIP, SDP, RTP, STUN, TURN, and ICE. It combines signaling protocol (SIP) with rich multimedia framework and NAT traversal functionality into high level API that is portable and suitable for almost any type of systems ranging from desktops, embedded systems, to mobile handsets.

PJSIP is both compact and feature rich. It supports audio, video, presence, and instant messaging, and has extensive documentation. PJSIP is very portable. On mobile devices, it abstracts system dependent features and in many cases is able to utilize the native multimedia capabilities of the device.

Learning VoIP, RTP and SIP (aka awesome pjsip) @ Medium.com


https://stackoverflow.com/questions/tagged/pjsip


This is interesting
Debugging SIP message traffic with PJSIP History