|
Monday, April 27, 2020
Fwd: OctaneRender 2020 and RNDR are out now!
Saturday, April 25, 2020
Fwd: [Newsletter] The final week of Bitmovin LIVE is upon us - learn about Live Low Latency Streaming and Data-Driven Workflows
| |||||||||||||||||||||||||||||||||||||||||
|
.png?width=1360&upscale=true&name=Blog%20-%20live-low-latency-streaming-NL%20(2).png "Blog - live-low-latency-streaming-NL (2)")
.jpg?width=1360&upscale=true&name=bitmovin-live-nab-2020-edition%20(1).jpg "bitmovin-live-nab-2020-edition (1)")
Wednesday, April 15, 2020
Sunday, April 12, 2020
Quantum camera snaps objects it cannot 'see'
A normal digital camera can take snaps of objects not directly visible to its lens, US researchers have shown. The “ghost imaging” technique could help satellites take snapshots through clouds or smoke.
Physicists have known for more than a decade that ghost imaging is possible. But, until now, experiments had only imaged the holes in stencil-like masks, which limited its potential applications.
Now Yanhua Shih of the University of Maryland, Baltimore, and colleagues at the US Army Research Laboratory, also in Maryland, have now taken the first ghost images of an opaque object – a toy soldier (see image, top right).
Quantum camera
Ghost imaging works a bit like taking a flash-lit photo of an object using a normal camera. There the image forms from photons that come out of the flash, bounce off an object and into the lens.
The new technique also uses a light source to illuminate an object. However, the image is not formed from light that hits the object and bounces back. Instead, the camera collects photons that do not hit the object, but are paired through a quantum effect with others that did.
In Shih’s experiments a toy soldier was placed 45 centimetres away from a light source, which was split into two beams. One was pointed at the toy and the other at a digital camera. A photon detector was placed near the soldier, able only to record when a photon bounced off.
Connected pairs
Photons from the light source constantly travel down both paths made by the splitter, either towards the soldier and the photon detector, or towards the camera. The detector and camera record a constant stream of those photons, and occasionally record a photon at exactly the same time.
When this happens, there is a direct relationship between where one of the photons hit the soldier, and where the other one hits the camera’s sensor, says Shih, because of a quantum effect called “two-photon interference”.
“If the first photon stops at one point on the object plane, the second photon can only be observed at the corresponding point on the image plane,” he says.
So when the camera records only pixels from photons that hit simultaneously with one reaching the detector, a “ghost image” of the object builds up. The soldier’s image appeared after around 1000 coincidental photons were recorded.
Sunny snaps
“It is clear that the experimental set-up can be directly applied to sensing applications,” Shih told New Scientist.
The same method could one day be employed to produce satellite images of objects hidden behind clouds or smoke, using the sun’s radiation as the photon source, says Shih. Doing that may require a photon counter beneath the clouds, but could allow a top-down view not possible using conventional methods.
Not everyone agrees that quantum effects are at work in ghost imaging, though. Baris Erkmen and Jeffrey Shapiro of the Massachusetts Institute of Technology, Cambridge, US, point out in a recent paper that classical physics says light sources produce numbers of uncoordinated photons that are not correlated as Shih suggests.
They suspect ghost images might be produced without a quantum link between photon pairs, purely because some photons are just similar.
Journal reference: Physical Review A (DOI: 10.1103/PhysRevA.77.041801)
Quantum World – Learn more about a weird world in our comprehensive special report.
https://www.newscientist.com/article/dn13825-quantum-camera-snaps-objects-it-cannot-see/
Thursday, March 12, 2020
Tuesday, February 04, 2020
Neural networks upscaling of 1896
Denis Shiryaev upscaled 60 fps 4k version of 1896 movie "Arrival of a Train at La Ciotat" with several neural networks
https://www.youtube.com/watch?v=3RYNThid23g
https://www.reddit.com/r/videos/comments/eyoxfb/oc_i_have_made_60_fps_4k_version_of_1896_movie/
Upscaled and resounded version of a classic B&W movie: Arrival of a Train at La Ciotat, The Lumière Brothers, 1896
Source used to upscale: https://youtu.be/MT-70ni4Ddo
Algorithms that were used:
››› To upscale to 4k – Gigapixel AI – Topaz Labs https://topazlabs.com/gigapixel-ai/
››› To add FPS – Dain, https://sites.google.com/view/wenbobao/dain
This is the interesting Bit:
Depth-Aware Video Frame Interpolation
Wenbo Bao*, Wei-Sheng Lai#, Chao Ma*, Xiaoyun Zhang*, Zhiyong Gao*, Ming-Hsuan Yang#&
*Shanghai Jiao Tong University, #University of California, Merced, &Google
Abstract
Video frame interpolation aims to synthesize non-existent frames in-between the original frames. While significant advances have been made from the deep convolutional neural networks, the quality of interpolation is often reduced due to large object motion or occlusion. In this work, we propose to explicitly detect the occlusion by exploring the depth cue in frame interpolation. Specifically, we develop a depth-aware flow projection layer to synthesize intermediate flows that preferably sample closer objects than farther ones. In addition, we learn hierarchical features as the contextual information. The proposed model then warps the input frames, depth maps, and contextual features based on the optical flow and local interpolation kernels for synthesizing the output frame. Our model is compact, efficient, and fully differentiable to optimize all the components. We conduct extensive experiments to analyze the effect of the depth-aware flow projection layer and hierarchical contextual features. Quantitative and qualitative results demonstrate that the proposed model performs favorably against state-of-the-art frame interpolation methods on a wide variety of datasets.
Update: Colorized by DeOldify Neural Network version of this video: https://youtu.be/EqbOhqXHL7E
This is an upscaled version of the gorgeous video by Bard Canning of curiosity descent uploaded on Sep 13, 2012,
source: https://youtu.be/Esj5juUzhpU
The video was upscaled with Gigapixel AI software to 4K, frame by frame, 60 FPS was achieved with After Effect frame blending. I made this video for fun, to spread the love of space traveling. Here is my telegram channel: http://t.me/denissexy Here is comparison: https://gfycat.com/diligentgianteaste... Here is a tutorial how to upscale things in Russian language: https://vc.ru/76580 x
Friday, November 01, 2019
OmniVision announces world record for smallest image sensor
OmniVision, a developer of advanced digital imaging solutions, has announced that it has won a place in the Guinness Book of World Records with the development of its OV6948 image sensor—it now holds the record for the smallest image sensor in the world. Along with the sensor, the company also announced the development of a camera module based on the sensor called the CameraCubeChip.
https://techxplore.com/news/2019-10-omnivision-world-smallest-image-sensor.html
Saturday, October 12, 2019
Thursday, October 10, 2019
NeTV2 - overlapping content on encrypted video signals. DMCA Lawsuit Progress
NeTV2 by Alphamax
An open video development board in a PCI express form factor that supports overlaying content on encrypted video signals. Let's bring open video to the digital age!
https://www.crowdsupply.com/alphamax/netv2
https://www.crowdsupply.com/alphamax/netv2/updates/bugfix-and-dmca-lawsuit-progress
An open video development board in a PCI express form factor that supports overlaying content on encrypted video signals. Let's bring open video to the digital age!
https://www.crowdsupply.com/alphamax/netv2
Bugfix and DMCA Lawsuit Progress
by Andrew H
Dear backers,
Things have been progressing quietly behind the scenes on NeTV2. Here’s two major developments that you might find particularly relevant.
First, the lawsuit challenging the constitutionality of the anti-circumvention provisions of section 1201 of the DMCA with respect to the NeTV2 is finally moving forward again. After a 2.5 year hiatus sitting on the judge’s bench, a ruling was made which is allowing the case to move forward toward a preliminary injunction that could enable much-requested features such as alpha blending and automatic colorspace selection, as well as finally opening the door for image processing and ML applications.
... Removed...
Finally, if you have any ideas or applications for NeTV2 that rely upon the right to access to plaintext video, please add them to
Thanks to everyone who has logged an issue here – the US government has made an argument that the 1201 exemptions sought around the NeTV2 would only benefit a very limited audience. This public list of ideas helps refute this argument, as well as the argument that non-infringing applications of the NeTV2 hardware are just “hypothetical uses”. This list helps to explain to regulators why the features that would be enabled by access to the plaintext video streams rise above the level of a “mere inconvenience.”
Happy hacking,
-b.
https://www.crowdsupply.com/alphamax/netv2/updates/bugfix-and-dmca-lawsuit-progress
Subscribe to:
Posts (Atom)
