Looks like Wheat Straw to me, did you use it for overseeding?

Yes, After the overseed they did put a bunch of straw. I have no idea if they were wheat straw or not.

How do I get rid of it?

The easiest way to get rid of it is to do nothing. It will die on its own. It's not well adapted to close and frequent mowing.

No need to worry about it. Don't use it next time you over seed. You really don't need to if you use a slitseeder or aerator. But, if you feel you must use a cover, then get PennMulch (it's weed seed free)But don't expect to pay $3 or $4 per bag like straw is, more like $9 to $11 per bag good for 700 sqf.

Click on the link below:

Here is a link that might be useful: PennMulch

I've got the exact same situation in my lawn. It's a brand new lawn seeded last fall (and used wheat straw). I haven't done anything to it yet, and I think auteck may be right about it going away on it's own. It's starting to turn brown at the base after 3-4 mowings and some 80 degree weather. The only thing I wonder is whether it's a one-time thing, or whether it will return each spring.

It will not come back next year.

Is it ok to pluck out these wheat grass with hand?

It is looking ugly in my yard.

Yes, it's perfectly ok to pluck them out and don't use wheat straw again.