First off you need to untangle the knots, and keep your fingers apart!
You need to keep a good consistent motion going with your fingers. Try curling your fingers more that will help, and depending on the speed of the song has alot to do with it as well. You must crab to the beat of the song, it's just like transforming to the beat of the song but faster ! A good practice is to snap your fingers starting with your pinky all the way to your index finger ! Snap all fingers and try to achieve a good flow, then try it on the fader.