Gestapo
The Geheime Staatspolizei, aka the Secret State Police. I wonder what that could be?
While the Abwehr was an ordinary intelligence organization whose main fault was that it was saddled with the wrong government, the Gestapo was organized primarily to be a Official Department of Evilness. While the Abwehr was responsible to the state, the Gestapo was responsible to the Nazi Party. Thus Hitler on the whole trusted the Gestapo more. As it turned out he may have been right to do so from his point of view, although having Hitler's trust isn't much of a compliment.
The Gestapo is the main point of reference we have when we think of the words Secret Police. Other such agencies existed previously, but the Gestapo made the trope famous. It helps that its name sounds so deliciously evil when you say it.
The Gestapo kept people in Hitler's empire terrorized and docile. They were always trying to convince people that they were everywhere . They were in charge of hunting fugitives from the concentration camps and those who sheltered or assisted them, and fighting against La Résistance. The Gestapo was famous for its fondness for Cold-Blooded Torture - the Gestapo Headquarters in Berlin was a building with no windows, but people passing by in the street could always hear screams and cries from inside.
Unfortunately for the Reich, they were not as skillful at dealing with other espionage agencies as they were at sowing terror. Officers were selected for political reliability rather than professionalism. And even more than the Abwehr, they were everybody's Chew Toy. However, there were some effective agents who served here. One of them was Reinhard Heydrich, the Chief of the Gestapo, who was known by Hitler as "the man with an iron heart". He served for ambition rather than ideology, but served very competently until he had the misfortune of being assassinated by La Résistance in Prague. Given that he was nicknamed "The Hangman" and gave the order for the Final Solution in the Holocaust, he probably deserved it.
In general the Gestapo was a scary organization. But it was far better at frightening people than it was at waging war.
On the other hand, contrary to popular belief usually fueled by incorrect portrayal of Gestapo in media (that often mix it up with SS, especially of Einsatzgruppen kind), Gestapo was, for the most part, rather ineffective organization. It was permanently understaffed (in extreme cases little more than 100 officers were given jurisdiction over the area inhabited by several millions of citizens). Gestapo staff was constantly overworked with red tape activities and could rely only on willingness of Germans eager to support the Nazi regime (which, frankly, usually bogged the proceedings further as officers had to separate useful information from exaggerations and blatant lies). In the occupied territories they were universally loathed and could rely only on informations gained from collaborators. Historians usually agree that despite notoriety it gained later, Gestapo was absolutely no match for Soviet NKVD.
And no, despite common portrayal in media, Gestapo officers never wore sinister black, leather coats courtesy of the SS complete with black Commissar Cap. That's pure Hollywood invention. Until 1936 they actually haven't had any specific uniforms and were plainclothes service. Later they were issued grey uniforms worn by all intelligence and SS administration services but being secret police most Gestapo officers preferred operating in civilian clothes and usually tried to protect their real identity.