Photoshop Gets ‘Copy & Paste’ Feature From IRL To Canvas In Artist’s AR Tool
By Izza Sofia, 07 May 2020
Image via Shutterstock
Artist and programmer Cyril Diagne has demonstrated a way to “copy and paste” items from the real world into Photoshop.
According to a video shared on Twitter, Diagne used augmented reality and machine-learning tech to copy visuals and paste them into digital documents. This tool will make designers’ job so much easier, as all they need to do is to point their phone camera at an object to integrate it into their laptop. They do not need to take a photo, edit it or insert the cutout into a document.
Diagne explained that his demonstration has a few moving parts. The first shows how the object on the foreground is separated from the background with the use of machine learning. The second component detects where your phone is pointing at on the laptop.
The artist explained that the whole process takes 6.5 seconds to complete—2.5 seconds to copy the item and four seconds to paste it on Photoshop.
He has shared the code on GitHub for those keen to check it out. The tool is currently only a research prototype, but has managed to blow away the team behind the Adobe Photoshop account.
4/10 - Cut & paste your surroundings to Photoshop
— Cyril Diagne (@cyrildiagne) May 3, 2020
Code: https://t.co/cVddH3u3ik
Book: @HOLOmagazine
Garment: SS17 by @thekarentopacio
Type: Sainte Colombe by @MinetYoann @ProductionType
Technical Insights: ↓#ML #AR #AI #AIUX #Adobe #Photoshop pic.twitter.com/LkTBe0t0rF
Hey @cyrildiagne , i love the demo, we are working on similar subjects with @photoroom_app . Would love to talk AI and UX with you. pic.twitter.com/zqmWLpfLud
— Matthieu Rouif (@matthieurouif) May 3, 2020
And again, the OpenCV SIFT trick to find where the phone is pointing at the screen.
— Cyril Diagne (@cyrildiagne) May 3, 2020
I also packaged it as a small python library: https://t.co/en0EyGSklp
Send a camera image + a screenshot and you get accurate x, y screen coordinates! pic.twitter.com/OOCFrrZseZ
Cut it out. No, seriously. https://t.co/Lulnwo9G6e
— Adobe Photoshop (@Photoshop) May 6, 2020
[via PetaPixel, opening image via Shutterstock]