So much at the bottom of the fermenter already

I just brewed my first batch of Red Ale with the Pico kit, I did everything according to the instruction for the Red Ale kit. I am now waiting for the yeast to go to work. However, I see a a lot of sediment at the bottom of the jug already, it's only been about a 1/2 hour. It looks like hops I strained it through a grain bag while I was pouring but so much still got through. Is ti good to let the wrot/beer to sit on this during the fermenting processes. I feel I need to rack it off so as to not get ant weird flavor. Thanks in advance for your help.

Al