Technologies
I've been lucky to work on a lot of cool projects. Here I will highlight a few.
Object-aware Refine Edge
A few years back I helped to advise on the creation of the Select and Mask workspace in Photoshop that allows users to select objects in images. Photoshop added a new mode that allows for improved extraction of hair for complex images. This mode is a follow on to our Deep Image Matting paper from CVPR 2017.
You can see this new mode discussed in the following video:
Select Subject for Portraits
Photoshop shipped a new version of Select Subject that automatically segments people in images. It is able to get fine detail like hair. Some of the technology that I have developed regarding selecting hair detail is part of this new feature.
The following video demos this new tool:
Object Selection tool
Photoshop released a new tool for easily selecting objects in images. The user needs to simply draw a rectangle or a lasso loosely around the desired object and the tool will accurately select the object. This tool is based on technology that I prototyped.
The following video gives more detail on this new feature:
Handwriting Recognition
The Adobe Research blog posted a story about some handwriting recognition I helped develop with collaborators from Brigham Young University.
The Adobe Research blog posted a story about some handwriting recognition I helped develop with collaborators from Brigham Young University.
You can read the story at the Adobe Research website here.
SceneStitch
SceneStitch
At Adobe MAX 2017 I demoed a cool new technology that I've been working on called SceneStitch. This allows you to pull content from external image repositories like Adobe Stock and use them to fill holes in your current image.
Check out this video explaining it:
At Adobe MAX 2017 I demoed a cool new technology that I've been working on called SceneStitch. This allows you to pull content from external image repositories like Adobe Stock and use them to fill holes in your current image.
Check out this video explaining it:
For more information, you can check out Adobe's blog post on SceneStitch here.
Auto Selection
Selecting objects in images can be a task requiring a lot of manual interaction. But not anymore, with the new Auto Selection tool in Photoshop Elements. With this tool, you can simply draw a bounding box around an object and get a good selection.
I lead the initial research into these ideas. We use some of Adobe Sensei's deep learning magic to make this happen.
This tool is highly inspired by our work Deep GrabCut published in BMVC 2017, though a whole lot has changed under the hood. You can see the paper here.
Color Chameleon
At Adobe MAX 2016, my colleague Scott Cohen present a color manipulation project that I helped guide. Take a look:
This demo is based on work that was done in collaboration with Michael Brown and Rang Nguyen from NUS. You can see the paper here.
Select and Mask
Interactive object selection is a vital intermediate task for many professional workflow. I helped develop the selection technology in the Select and Mask tool to improve the user interaction experience.
There is another nice video showing this technology in action here.
Photoshop Mix selection tools
Photoshop Mix is an app that allows users to select objects from images and composite them to new images. The selection tool and auto select feature in it are based on methods I developed.