Comfyui face swap video reddit

Comfyui face swap video reddit. That said, I'm looking for a front-end face swap, something that will inject the face into the mix at the point of ksampler, so if I prompt for something like Freckles they won't get lost in the swap/upscale but I've still got my likeness. Hi I am looking for feedback on people's experience with face swapping on video. For anime look, i suggest inpainting the face afterward, but you want to experiment with the denoise level. I would like to just be able to face swap the eyes area, so i can make a more consistent look. It may improve depending on your case. for those with only one character, i could do face swap with ipadapter face id models, but I am wondering how i can do it with multiple characters in the picture. Since version 0. Please share your tips, tricks, and workflows for using this software to create your AI art. reactor is a castrated version of face fusion that can be used directly in A1111. . com/Gourieff/comfyui-reactor-nodeVideo Helper Suite: ht When using Roop (faceswaping extension) on sdxl and even some non xl models, i discovered that the face in the resulting image was always blurry. If you want some some face likeness, try detailing the the face using impact pack, but use the old mmdet model, because the new utralytic model is realistic. Thank you again! Nevertheless, I found that when you really wanna get rid of artifacts, you cannot run a low denoising. For general upscaling of photos go: remacri 4x upscale resize down to what you want GFPGAN sharpen (radius 1 sigma 0. You can swap faces in individual images or all images in a directory. Forget face swap. It doesn't do head or person swap. ComfyUI, combined with stock or your own videos, can transform your storyboarding and video projects. Additionally, it allows you to stitch these segments back together. e. You can swap one face or multiple faces in a video. I'm looking for the best method to perform a face swap on video clips where the subject is facing the camera. The face model is not similar to a checkpoint or a LoRA. For the face swapping effect in the picture, I directly used the open source roop plugging. The thing is, I want to use comfyui because it is easier to use. info/ however, the only node I can find for face fixing (FaceRestoreWithModel) seems to accept just the two models mentioned above. Also watch Laten't Vision's vids and tutorials. Faces always have less resolution than the rest of the image. It helps extract scenes with humans, scenes without humans, scenes without a face, scenes with a face, and faces at specific angles. 4) Then you can cut out face and redo-it with IP Adapter. Welcome to the unofficial ComfyUI subreddit. mtb node has face swap, kinda like roop, but not as good as training with lora. Use IP Adapter for face. com/dataleveling/ComfyUI-Reactor-WorkflowCustom NodesReActor: https://github. The subject and background are rendered separately, blended and then upscaled together. If your source image has multiple faces, you can target the desired one via an index value. *ComfyUI Workflow* - https://drive. For example, a professional tennis player pretending to be an amateur tennis player or a famous singer smurfing as an unknown singer. I hav no idea how did you even made a video faceswap in A1111 with reactor. All packages were forked directly from the #! repositories/Github and changed only where necessary to keep it up to date with newer packages. Created by: CgTopTips: With ReActor, you can easily swap the faces of one or more characters in images or videos. Lightning speed face swapping with all the features Upscalers Likeness modifiers Orientation management Masks: borders, differentials, auto occlusion, face parsers, text-based masking-all with strength adjustments and blending settings Mask view to evaluate masks directly Source face merging and saving Swap images or videos Feb 28, 2024 · Workflow: https://github. Still, gotta respect their decision, even if face-swapping already has its own ethical grey areas. The video has to be an activity that the person is known for. Jul 31, 2024 · Posted in r/comfyui by u/Automatic_Berry7474 • 3 points and 1 comment Very simple workflow. So I spent 30 minutes, coming up with a workflow that would fix the faces by upscaling them (Roop in Auto1111 has it by default). The general idea and buildup of my workflow is: Create a picture consisting of a person doing things they are known for/are characteristic for them (i. com/file/d/1EMAuVgPnOLXr2VFm5zW-Yh_yfFecNNFl/v Welcome to the ComfyUI Face Swap Workflow repository! Here, you'll find a collection of workflows designed for face swapping, tailored to meet various needs and preferences. I'm leaving aside the fact that inswaper128 model (which is used in roop) was designed for swapping faces quite small 128x128 everything bigger is the work of an upscaler (GAN, codeformer, etc). Well I can get it working fine (I'm using ReActor but have tried vanilla roop), but the faces are just all pretty low-res. I have to push around 0. I love that and I'm trying to find a good workflow for my image creation + face swapping. See, this is another big problem with IP adapter (and me) is that it's totally unclear what all it's for and what it should be used for. Also the face mask seems to include part of the hair most of the time, which also gets lowres by the process. You can swap the face of one or more subjects in any image with the face of choice. In A1111 I tried Batch Face Swap extension for creating a mask for face only, but then I have to run the batch three times (first for the mask, second for inpainting with masked face and third for face only with adetailer). My approach is to split the video into individual frames, use Segment Anything to obtain the human mask, then use VAE inpaint encoder to convert it into latent space. youtube. com/watch?v=4ay8C8dAqEg. I was trying to keep it to a simple process, but the face swap keeps restoring the face so that it doesn't match the style at all, even if I use a different checkpoint. At this stage, you can save the image, but I've got roop (face-swap) and face-restorer taking this image to make it more what I want. Our tool works well even if there are many people in the video. For videos of celebrities just going undercover and not doing the activity they are known for please submit to /r/UndercoverCelebs. However, I am noticing that the resolution of the video goes down after the processing. This is another implementation of face swapping. I use ControlNet to capture the actions of the characters in the original video, then feed the new character portraits with removed backgrounds into IPAdapter. But it gave better results than I thought. Re Joker, have had pretty good results using reactor face swap, using for example Jokers face as source, then swap with whoever you want, tends to keep core joker skin colours mostly intact, but far from perfect or in control of detail. Hi guys, I used a111 for some time and now I'm switching to comfyui (portable). Or any suggestions as to how to marry a head and a body would be greatly… Guess the model those solutions use is just too lowres, so you don't get good results with the new higher resolutions SDXL provides. Does anyone know of a "head swap" workflow - not just face, but entire head. You can't use that model for generations/ksampler, it's still only useful for swapping. Yeah what I like to do with comfyui is that I crank up the weight but also don't let the IP adapter start until very late. In face fusion it takes like 10 seconds However the one thing I cannot for the life of me get working properly is face swap. DOES anyone know where I could get a workflow that will just accept an mp4 and a face image and it does everything to convert or whatever to just output the same video with just the face swapped? Oct 13, 2023 · With the easy implementation of ComfyUI's Custom Note, you'll be able to create face swap images and animations in ComfyUI quickly. CrunchBangPlusPlus (or #!++) is an effort to continue the #! environment. But what is good FaceSwap app you don't have video cutter that can cut by person detection, face detection, or face angle. Please keep posted images SFW. I could have something that seems entirely cartoonish with an eerie, lifelike face. In either case, you must load the target image in the I2I section of the workflow. Face Swapper. I wanted to be able to generate a simple square image of a well framed head and face that could be fed without modification to the ReActor face swap node, I found the normal shot control prompts (medium closeup, straight on, looking at viewer, etc. It is meant to be a faster solution to do "face" swap. Di reactor face swap Been using the face swap for a while - all of the sudden node disappered - turns out its failing to import - anyone else had this particular issue - totally confused - have tried reinstalling it - both from github and via the node manager. FILM VFI (Frame Interpolation using Learned Motion) generate intermediate frames between images, effectively creating smooth transitions and enhancing the fluidity of animations. https://www. Typically resulted in cutoff head, annoying head positions, etc. r/comfyui • I made a composition workflow, mostly to avoid prompt bleed. In fact, our current self-developed face swapping will still have the problem that the face does not look like the original face, but the effect will still be better than roop, as shown in the picture below. The "FACE_MODEL" output from the ReActor node can be used with the Save Face Model node to create a insightface model, then that can be used as a ReActor input instead of an image. Achieve clear and realistic results with our advanced AI technology. Is there any way to use a face restore model OTHER THAN cfpgan or codeformer in Comfy? There are a number of face-optimizing models on https://openmodeldb. However, i notice that if the moth is doing anything, or even that part of the face is covered by a shoulder or anything, the face swap messes up the picture a lot. The way I could see it working is you start your work flow with an image of a pose fed into controlnet and/or a desciprtive prompt to generate your base, then just has you would use Reactor with a picture of a model to face swap to, you could also have the ability to feed it specific pictures of the target body partsleft arm, right arm Thanks. Still using the same inswap128 model in a1111 and the face quality is so much better, what am I doing wrong? Here's FaceSwap with Reactor with a very cool optional, which is FaceAnalysis. And Also Bypass the AnimateDiff Loader model to Original Model loader in the To Basic Pipe node else It will give you Noise on the face (as AnimateDiff loader dont work on single image, you need 4 atleast maybe and facedetailer can handle only 1 ) Face Swapper. Like 0. I'll play around and see what I find. Hi guys, I try to do a few face swaps for fare well gifts. 8 even. 3 in order to get rid of jaggies, unfortunately it will diminish the likeness during the Ultimate Upscale. You can also use ctrl button to select multiple faces. 0 you can save face models as "safetensors" files (stored in ComfyUI\models\reactor\faces) and load them into ReActor implementing different scenarios and keeping super lightweight face models of the faces you use. Which does not happen when I use Roop. ) didn't work well. Video Face Swap Want to change faces in your videos? DeepSwapper's video feature makes it easy. I am looking to do a face swap on the following video. As we showed in our previous video, we demonstrated In this video, we will see how to face swap in a video using ReActor. 4. Just use Reactor. DM/comment for question or your experiential needs. It never producec the same level of quality as facefusion. So that the underlying model makes the image accordingly to the prompt and the face is the last thing that is changed. Now I'm seeing this FaceSwapLab module for A1111 and looks very interesting, what I'm not sure is if you can directly swap faces on videos, or if it's limited to single images. It is less of a model and more like a "face preset". Thumbnail Hello r/comfyui I made a video showing how to install and setup InstaSwap. I would like to be able to face swap to achieve a more consistent character. Honestly, the best thing you can do is use your own face, use your own generation, or get explicit permission. 4 alpha 0. We do not encourage stolen content and unauthorized face-swap (deepfake). Should the latter be true, what's the current to-go software to perform face swaps on movies? Thanks! Put ImageBatchToImageList > Face Detailer > ImageListToImageBatch > Video Combine. /r/StableDiffusion is back open after the protest of Reddit killing open API access, which will bankrupt app developers, hamper moderation, and exclude blind users from the site. google. It only works with ReActor and maybe other nodes using the same technology. Roop isn't that good for anything else than a face with a closed mouth, teeth are usually out of the question. Here is the… Hi, i am trying to perform face swap on animal characters on children's storybooks. If you are getting started, check out his other videos as well, they are all pretty great. Anyone know of a good workflow that can faceswap videos without ruining the high quality resolution of the input video? Welcome to the unofficial ComfyUI subreddit. Let us know if you find it useful and stay tuned for the next post! DISCLAIMER: all images here are generated. #!++ a lightweight Debian-based distribution featuring the Openbox and GTK+ applications. That determines how close the generated output face matches with its source. And very recently, I've added a solution provided by the bright mind who came up with the Manager and other stuff we use in ComfyUI - I reckon he's a genius! - to fix the hands. It's perfect for modifying a movie or TV show clip. This video specfically addresses clothing replacement: Face + Pose + Clothing. I've been using a ComfyUI workflow, but I've run into issues that I haven't been able to resolve, even with ChatGPT's help. (just the short version): photograph of a person as a sailor with a yellow rain coat on a ship in the rough ocean with a pipe in his mouth OR photograph of a young man in a sports car Thanks for the reply. Additionally Batch Face Swap sometimes doesn't detect the face and the process is getting too complicated. He is the author of the IPAdapeter Plus nodes, and has amazing videos. Just install it and see for yourself. If you want to learn how to Rope Pearl for both video deep fakes and image face swapping this is the best tutorial made so far. rxfrb ztqvm whsnk nih moz okl hdwauk xvmfm pwaml ven