Sunday, April 3, 2016

How to train undergraduate psychologists to be post hoc BS generators

Teaching undergraduate psychology is difficult for a variety of reasons. Students come in with preconceived notions about what psychological research is and are sometimes disappointed with the mismatch between their preconceptions and reality. Much of what psychologists do is highly specialized and requires skills that are difficult to teach, and psychologists-in-training can't offer much research-wise until they have years of experience. The assignments we ask undergraduates to complete are meant to train their critical thinking skills to prepare them for a more substantive contribution to research. Sometimes, however, they do exactly the opposite; instead, assignments can reward post hoc BS generation rather than actual critical thinking.



If the recent so-called crisis in psychology has highlighted anything, it is the prevalence and danger of post hoc narratives. Although statistical practices (e.g., use if significance testing) have gotten much of the blame -- at least in my corner of the research world -- the main problems are actually a level or two above that. Combining ill- or flexibly-defined theoretical concepts, post hoc reasoning, and publication bias yields a potent mixture that I would argue is responsible for the crisis.

I have been thinking about this in the context of assignments that we ask our undergraduates to do, and how we actually train post hoc reasoning early on. Here I'll offer examples of two undergraduate assignments that I think reward scientists-in-training for their BS generation skills. I'll also elaborate on what I think we can do about this.
The "Texas Sharpshooter" paints the target around his bullet holes.

Example assignment: Critique a peer-reviewed article

The assignment: Students are assigned an article from a peer-reviewed psychological journal and asked to critique it. Ideally, they develop choose a few critiques for which they argue for in their essay.

The basic problem with this assignment is that students are not particularly well-versed in any particular psychological topic, nor in psychological research methods. On the other hand peer-reviewed articles have been reviewed by people who are, which means that whatever problems remain with the research have evaded skilled reviewers. This is not to say that peer-reviewed research does not have major problems, but it does mean that students who have had only a few basic courses and do not have much experience in reading peer-reviewed research are unlikely to be able to find good quality-critiques spontaneously.

Upon reading such an article and having difficulty find a critique, a student is in an awkward position: they must write an essay. So what do they do? They come up with whatever critiques come to mind, which are likely to be low-quality critiques. I suspect readers of this blog have experienced these sorts of critiques in student assignments: maybe there are cultural differences? The sample seems small. Are these really the best stimuli to use? They must choose a number of these arguments, and argue for them, in spite of the fact that they don't have sufficient knowledge on which to base such a critique. We're training them in the fine art of bullshit.

This is not to say that these problems don't occur in some studies. But forming a good argument why takes specialized knowledge they they don't yet have, so we get back noise from the students. And who gets the best marks for such an assignment? Students who can write clearly about things of which they have little actual understanding.

We have to ask ourselves: is it any wonder that we have a replication crisis?

Example assignment: Do an experiment and interpret the results

The assignment: Students are asked to perform a simple experiment (often in groups), analyze the data, and report the results. They must interpret the results in light of the research they've read (often primarily the textbook).

Experience doing simple experiments and analyzing the results is critical to a psychologist-in-training. But how the assignment is framed and marked is critical to whether we are training the skills we want. Students in chemistry, biology, and physics all perform easy experiments and report the results; this is as it should be.

What is different about interpreting the results of a typical psychology experiment and that of a chemistry experiment is that there are very strong reasons to expect something specific to happen in the chemistry experiment. If the psychology experiment doesn't come out as the textbook predicts, though, they must describe why that might be. There are, of course, a hundred possible reasons why this might be the case, including the possibility that the original study was wrong, statistical noise, and sloppiness in their experimental procedure.

But these explanations will not be the ones they will explore. We require students to show creativity and independent reading/thought. In an assignment like this, students know that the best way to get a good mark is to find a paper whose logic might predict the results obtained, and include a cogent argument why this might have caused the differences. The students turn in the paper, and will not test their hypothesis, of course; the argument is simply thrown in to get a better mark. The students who do the most independent reading and form the best-sounding argument will get the best mark.

This should all sound eerily familiar: we are training them in the time-honored tradition of post hoc arguments for "hidden moderators".

Fixing the problems

If we want to train good psychologists, we must be very sensitive to the skills we're actually teaching, as opposed to those we think we are teaching. The practices in the field will be a reflection of what students are taught. How might we use assignments to train critical thinking, without teaching bad practice?

Critiquing pop science

The problem with the critique of the peer-reviewed article is that students are unlikely to be able to spot the real problems with the article. This is somewhat like asking first-year sports therapists to critique a professional sports player's technique; the imperfections are simply too fine, because the professionals have been honing their craft with help for years. It would be better to ask them to critique amateur sports players' techniques, because they will have more glaring problems.

Unfortunately, there is no "amateur" peer-reviewed research. There is, however,  a lot of very bad non-peer-reviewed pop science. Psychologists-in-training would benefit from assessing bad popular science (not just popular psychology) assessing, for instance, spurious claims of causation (vs correlation), overblown effect sizes, and mismatches between what is claimed about a research in a pop article versus what was actually done. Critiquing popular science develops the similar skills as critiquing a peer-reviewed article, without the unfortunate side effect of asking students to BS their way to a good mark.


Separating critiques of method from critiques of results

Critiquing methods along side of the results leads to the unfortunate asymmetry that if an experiment yields the expected result, the methods are not critiqued, whereas if it doesn't, the students are encouraged to generate BS reasons why it might not work, with no expectation of testing those reasons. If students were asked to critique methods by themselves, then they would not be rewarded for such post hoc reasoning. Moreover, in an essay of typical length, this leaves more room to discuss reasons why the methods are problematic; for instance, if the sample size is problematic, a methods-only critique would allow space for a power analysis. In a methods+results critique, I often see critiques of sample sizes with no corresponding argument why the sample size is a problem.


Being specific about potential critiques

In whatever assignments we give to undergraduates, we should be specific about what sorts of critiques we are expecting, preferably giving a short list of possible critiques. The students will still have to read the target article, but instead of giving a shot in the dark and being forced to argue for it, students will be forced to ask, for instance, "Does this research suffer from a confound with X?", or "is this experiment sufficiently powered to detect an effect size of Z?" or "Does this DV represent a good operationalization of W?"

Perhaps, for instance, power is not a problem; they would then be in a position to argue that, yes, the experiment is sufficiently powered, instead of always (vaguely) attacking an article. Always asking for critique teaches the students that critical thinking is about dreaming up as many ways to attack an article as possible, and then forming a plausible-seeming argument around them. In contrast, being very specific about possible critiques -- that may not, in fact, turn out to be problems -- will develop critical thinking and argumentation skills better.

Wrap up

If we believe psychology is in crisis, we should look at the way we train undergraduates to see if part of the problem lies there. I think the crisis in psychology is reflected in some ways in our training. Doing better is not just about better statistical training or better open science training; it is also about ensuring a match between what we think we are teaching and what we actually teach. 

80 comments:

  1. By definition, if you pick a random article from the literature then the remaining problems are those that the reviewers didn't spot, but one might expect those errors to have some sort of distribution, and there will be some fun to be had in the right-hand tail of that distribution. So I don't see that there is necessarily a problem with critiquing an article, as long as it is carefully chosen to be a bad one with an interesting selection of deficiencies, some more obvious than the others.

    Perhaps a bigger problem is the Dodo bird approach to marking such assignments, in which the student who actually nails the critical problem will probably not get a much better mark than the one who merely asks vague questions about culture or sample size. But I'm not sure that this is much of a problem, because (it seems to me, but perhaps I'm just being hopeful) the majority of those in the latter category are not going on to be researchers anyway.

    ReplyDelete
    Replies
    1. I agree that there are articles out there that might be used for this purpose; I think, though, that these articles are hard-ish to find because they have to be really bad. If you've got to find a new one every year, that's going to be a tall order for a single lecturer.

      Even if you do find such an article, for undergraduate pedagogy, it pays to be specific about what sorts of problems you might be looking for (and to throw some issues into the mix that are not problematic, so they'll learn not to attack everything in sight).

      Delete
    2. Students can't be expected to learn from critiquing real articles because it's too hard, because they don't know how to critique real articles? ;)

      I agree with most of the elements here, especially specificity, but feel it's kind of getting it backwards. There's no such thing as an article so apt for learning methodology that you can just throw it at students with an essay instruction and expect more than a small fraction to successfully re-invent the methodological wheel, or even to make meaningful progress. And even if there was, it wouldn't stay that way for very long.

      It's not the material. Students need clear expectations, and they need to see how it's done first. Not perfectly, but good enough, before they're ready to start attempting for themselves. Then, they need active and specific feedback (not "four weeks after" feedback). People who do internships get those things, so they learn to DO science, not just ABOUT science. Many professors, in my experience, deny students that basic, critical scaffold during their classes, partly due to time constraints, but also deliberately in pursuit of some vague ideal of teaching them about "thinking for yourself." (It's never quite clear exactly what is meant by this, but by golly, its status as a universal good is beyond reproach and I am offended you'd even think to question it.)

      This is a massive mistake. I sure know I had to learn from listening directly to and interacting with people like you pick apart papers, concepts and ideas, and try to understand your reasoning, before I was ready to try for myself. Although, of course, the quality of my learning is arguable.

      Delete
    3. I will always keep on writing good and posting my testimonies about you on the Internet,I have been diagnosis with Parkinson for 3 yrs I was tested Parkinson positive,I lost hope and I wept all day,i needed to get cured on time so i was introduced by a blogger who also narrated Her story online on how she was cured of Parkinson by a herbal medication which was sent by Dr Ben i am totally free from Parkinson for anyone that may need the cure should contact Dr Ben on

      Benherbalcure@gmail.com
      Whatsapp him on +905385050893

      Delete
    4. I was diagnosed with Parkinson’s disease nearly 4 years ago, at 51. I had a stooped posture, tremors, muscle stiffness, sleeplessness, slow movement. I was placed on Sinemet for 7 months and then Sifrol and Rotigotine was introduced which replaced the Sinemet but I had to stop due to side effects. Last year, I started on Parkinsons disease herbal treatment from Priestess Hallifat Herbal Home, this natural herbal treatment totally reversed my Parkinsons disease. for recommendation
      ( lifecentre@live .com )

      Delete
    5. I want to share this great testimony to the world on how Dr VOODOO cure me from HSV1&2 with his herbs, I was nervous when i first contact him about the cure for HSV but i decided to give him a try because i was desperate to get cured and be free from HSV. Dr VOODOO prepared the remedy and sent it to me through UPS,which I use just the way Dr VOODOO instructed me and thank God today I am a beneficiary to this cure and I went back to the hospital after 7 days of taking the herbs and I tested HSV1&2 Negative. So I will tell you all who are looking for a cure to his/her HSV1&2 that Dr VOODOO took research before he could finally get the solution to it and a lot of people are benefiting from him right now. He also cured my friend from HPV. Dr VOODOO heals with natural herbs. Please I urge you to contact him now through his email address: voodoospelltemple66@gmail.com or call and WhatsApp him on +2348140120719. He is capable of curing HIV/AIDS, HERPES, HPV, HSV1&2, CANCER of all kinds, DIABETES and so many other infections.

      Delete
  2. Thank you for this! I would have loved to see this post as an undergraduate, speaking as a rather good 'can write clearly about things of which they have little actual understanding' type of student, or at least a discussion on the subject during my studies. One of the benefits of these 'critique' assignments has, for my generation, been promoting creative writing, and some of my colleagues actually landing journalist(ic) jobs. Fixing problems was never a big part of the curricula, which is odd, and let me explain why. I'm a graduate student at a university where you can get a 'psychology' degree (MA), meaning there are no more or less scientific-focused, or practice-focused programs. Most of my colleagues, and any of the university's critics would probably call for more practical knowledge in terms of work-related practice, especially since the statistical and methodological subjects represent a fair amount of the program, which seems pretty 'scientific'. But here's the catch: important issues like these are never discussed with most of the students, since it's expected that only a few (if so) will want or get to the doctorate program, and eventually probably stay as employees. These issues are tackled at the doctorate level, and the rest of us only have to 'survive' writing our one thesis, with most of us ending up in areas we were never interested in - and I have to say - with work bringing little to none value to the 'real' scientific body of knowledge. With the risk of sounding like a victim here, it seems that this is just another demotivating mechanism for us 99% of non-doctorate students. I have to agree with Chistian H. on learning by listening to people like you, and the internships part, only in my case it's the stay-as-TA's people. I'm fortunate in having a mentor for my thesis with similar interests, so I do get great and prompt feedback, plus he teaches a couple of classes which are basically online discussion forums, so there are some improvements. Still, it was clear from day one - I was never going to stay as a TA, so there's really no point in bothering me with all that extra knowledge.

    ReplyDelete
  3. This comment has been removed by a blog administrator.

    ReplyDelete
  4. It’s a shame you don’t have a donate button! I’d certainly donate to this brilliant blog! I suppose for now i’ll settle for book-marking and adding your RSS feed to my Google account. I look forward to fresh updates and will talk about this blog with my Facebook group. Chat soon!
    _________________________
    Video player for Mac

    ReplyDelete
  5. I once had the "luck" of being made co-author on a very bad paper, and for reasons beyond the scope of this reply I decided not to retract my authorship. This enabled me to give students that paper, with the mission of finding at least 3 glaring errors, and teaching them to do so even if the teacher is one of the co-authors.

    ReplyDelete
  6. Really your article was full of quality word with good structure thanks for share it critiquing qualitative research.

    ReplyDelete


  7. Thank you for your post. This is excellent information. It is amazing and wonderful to visit your site.
    Oracle Reseller servies in north america

    ReplyDelete
  8. COEPD LLC- Center of Excellence for Professional Development is the most trusted online training platform to global participants. We are primarily a community of Business Analysts who have taken the initiative to facilitate professionals of IT or Non IT background with the finest quality training. Our trainings are delivered through interactive mode with illustrative scenarios, activities and case studies to help learners start a successful career. We impart knowledge keeping in view of the challenging situations individuals will face in the real time, so that they can handle their job deliverables with at most confidence.

    http://coepd.us/

    ReplyDelete
  9. Irrespective of receiving daily oral or future injectable depot therapies, these require health care visits for medication and monitoring of safety and response. If patients are treated early enough, before a lot of immune system damage has occurred, life expectancy is close to normal, as long as they remain on successful treatment. However, when patients stop therapy, virus rebounds to high levels in most patients, sometimes associated with severe illness because i have gone through this and even an increased risk of death. The aim of “cure”is ongoing but i still do believe my government made millions of ARV drugs instead of finding a cure. for ongoing therapy and monitoring. ARV alone cannot cure HIV as among the cells that are infected are very long-living CD4 memory cells and possibly other cells that act as long-term reservoirs. HIV can hide in these cells without being detected by the body’s immune system. Therefore even when ART completely blocks subsequent rounds of infection of cells, reservoirs that have been infected before therapy initiation persist and from these reservoirs HIV rebounds if therapy is stopped. “Cure” could either mean an eradication cure, which means to completely rid the body of reservoir virus or a functional HIV cure, where HIV may remain in reservoir cells but rebound to high levels is prevented after therapy interruption.Dr Itua Herbal Medicine makes me believes there is a hope for people suffering from,Parkinson's disease,Schizophrenia,Cancer,Scoliosis,Fibromyalgia,Fluoroquinolone Toxicity
    Syndrome Fibrodysplasia Ossificans Progressiva.Fatal Familial Insomnia Factor V Leiden Mutation ,Epilepsy Dupuytren's disease,Desmoplastic small-round-cell tumor Diabetes ,Coeliac disease,Creutzfeldt–Jakob disease,Cerebral Amyloid Angiopathy, Ataxia,Arthritis,Amyotrophic Lateral Sclerosis,Alzheimer's disease,Adrenocortical carcinoma.Asthma,Allergic diseases.Hiv_ Aids,Herpes,Inflammatory bowel disease ,Copd,Diabetes,Hepatitis,I read about him online how he cure Tasha and Tara so i contacted him on drituaherbalcenter@gmail.com even talked on whatsapps +2348149277967 believe me it was easy i drank his herbal medicine for two weeks and i was cured just like that isn't Dr Itua a wonder man? Yes he is! I thank him so much so i will advise if you are suffering from one of those diseases Pls do contact him he's a nice man.

    ReplyDelete
  10. My life is beautiful thanks to you, Mein Helfer. Lord Jesus in my life as a candle light in the darkness. You showed me the meaning of faith with your words. I know that even when I cried all day thinking about how to recover, you were not sleeping, you were dear to me. I contacted the herbal center Dr Itua, who lived in West Africa. A friend of mine here in Hamburg is also from Africa. She told me about African herbs but I was nervous. I am very afraid when it comes to Africa because I heard many terrible things about them because of my Christianity. god for direction, take a bold step and get in touch with him in the email and then move to WhatsApp, he asked me if I can come for treatment or I want a delivery, I told him I wanted to know him I buy ticket in 2 ways to Africa To meet Dr. Itua, I went there and I was speechless from the people I saw there. Patent, sick people. Itua is a god sent to the world, I told my pastor about what I am doing, Pastor Bill Scheer. We have a real battle beautifully with Spirit and Flesh. Adoration that same night. He prayed for me and asked me to lead. I spent 2 weeks and 2 days in Africa at Dr Itua Herbal Home. After the treatment, he asked me to meet his nurse for the HIV test when I did it. It was negative, I asked my friend to take me to another nearby hospital when I arrived, it was negative. I was overwhite with the result, but happy inside of me. We went with Dr. Itua, I thank him but I explain that I do not have enough to show him my appreciation, that he understands my situation, but I promise that he will testify about his good work. Thank God for my dear friend, Emma, I know I could be reading this now, I want to thank you. And many thanks to Dr. Itua Herbal Center. He gave me his calendar that I put on my wall in my house. Dr. Itua can also cure the following diseases ... Cancer, HIV, Herpes, Hepatitis B, Inflammatory Liver, Diabetis, Fribroid,Parkinson's disease,Inflammatory bowel disease ,Fibromyalgia, recover your ex. You can contact him by email or whatsapp, @ .. drituaherbalcenter@gmail.com, phone number .. + 2348149277967 .. He is a good doctor, talk to him kindly. I'm sure he will also listen to you.

    ReplyDelete
  11. Great blog is this and It have good information. On this November enjoy and get advantage of Black Friday and Cyber Monday Deals specially Victorias Secret Body Lotions Deals Black Friday .

    ReplyDelete
  12. I am bold enough among many others to state that there is now a potent cure to this sickness but many are unaware of it. I discovered that I was infected with the virus 3 months ago, after a medical check-up. My doctor told me and I was shocked, confused and felt like my world has crumbled. I was dying slowly due to the announcement of my medical practitioner but he assured me that I could leave a normal life if I took my medications (as there was no medically known cure to Herpes). I went from churches to churches but soon found that my case needed urgent attention as I was growing lean due to fear of dying anytime soon. In a bid to look for a lasting solution to my predicament, I sought for solutions from the herbal world. I went online and searched for every powerful trado-medical practitioner that I could severe, cos I heard that the African Herbs had a cure to the Herpes syndrome. It was after a little time searching the web that I came across one Dr Itua(A powerful African Herbal Doctor), who offered to help me at a monetary fee. I had to comply as this was my final bus-stop to receiving a perfect healing. My last resolve was to take my life by myself, should this plan fail. At last it worked out well. He gave me some steps to follow and I meticulously carried out all his instructions. Last month, to be precise, I went back to the hospital to conduct another test and to my amazement, the results showed that negative,Dr Itua Can As Well Cure The Following Desease…Cancer,Hiv,Herpes, Hepatitis B,Liver Inflammatory,Diabetis,Fribroid,,Non Hodgkin Lymphoma,Skin Cancer,Uterine Cancer,Prostate Cancer Dercum,Infertility,fibromyalgia,Get Your Ex Back,Als,SYPHILLIS,Genetic disease,Epilepsy, Parkinson's disease..You can free yourself of this Herpes virus by consulting this great African Herbal Doctor via this e-mail: drituaherbalcenter@gmail.com or call and whatsapp him on +2348149277967 He will help you and his herb medication is sure. he has the cure on all disease .You can talk to me on INSTAGRAM..tashamoore219....

    ReplyDelete

  13. Hello,
    My name is sophia miller.
    thanks for this information.
    Get the best Finance Assignment Help anytime.

    ReplyDelete
  14. I am bold enough among many others to state that there is now a potent cure to this sickness but many are unaware of it. I discovered that I was infected with the virus 3 months ago, after a medical check-up. My doctor told me and I was shocked, confused and felt like my world has crumbled. I was dying slowly due to the announcement of my medical practitioner but he assured me that I could leave a normal life if I took my medications (as there was no medically known cure to Herpes). I went from churches to churches but soon found that my case needed urgent attention as I was growing lean due to fear of dying anytime soon. In a bid to look for a lasting solution to my predicament, I sought for solutions from the herbal world. I went online and searched for every powerful trado-medical practitioner that I could severe, cos I heard that the African Herbs had a cure to the Herpes syndrome. It was after a little time searching the web that I came across one Dr Itua(A powerful African Herbal Doctor), who offered to help me at a monetary fee. I had to comply as this was my final bus-stop to receiving a perfect healing. My last resolve was to take my life by myself, should this plan fail. At last it worked out well. He gave me some steps to follow and I meticulously carried out all his instructions. Last month, to be precise, I went back to the hospital to conduct another test and to my amazement, the results showed that negative,Dr Itua Can As Well Cure The Following Desease…Cancer,Hiv,Herpes, Hepatitis B,Liver Inflammatory,Diabetis,Fribroid,,Non Hodgkin Lymphoma,Skin Cancer,Uterine Cancer,Prostate Cancer Dercum,Infertility,fibromyalgia,Get Your Ex Back,Als,SYPHILLIS,Genetic disease,Epilepsy, Parkinson's disease..You can free yourself of this Herpes virus by consulting this great African Herbal Doctor via this e-mail: drituaherbalcenter@gmail.com or call and whatsapp him on +2348149277967 He will help you and his herb medication is sure. he has the cure on all disease .You can talk to me on INSTAGRAM..tashamoore219....

    ReplyDelete
  15. I have long felt a special connection with Herbal Medicine. For one thing is natural, Charlie we went to the same small college in Southern California — Claremont Men’s College — though he dropped out and ultimately enrolled at the Julliard School of the Performing Arts in New York. Had he stayed at Claremont, he would have been a senior the year I started there; I have often kidded that I was the reason he left when he finds out I had herpes. So my life have been lonely like hell all day I couldn't bear the outbreak pain, Tasha then introduce me to Dr Itua who use his herbal medicine to cure her two weeks of drinking it. I place an order form him and he delivers to my post office then I picked it up and used for two weeks all my sore was healed completely no more outbreak I'm honestly telling you this man is a great man, I trust him and his herbal medicine so much I'm sharing this to show my appreciation also to let sick people know there is hope with Dr Itua Herbal Made Medicine.Dr Itua Contact Email.drituaherbalcenter@gmail.com,Whatsapp.+2348149277967
    He cures.
    Herpes,
    STROKE.
    Hepatitis
    H.P.V TYPE 1 TYPE 2 TYPE 3 AND TYPE 4. TYPE 5.
    HIV
    SYPHILIS.
    Liver/Kidney Inflammatory
    Epilepsy

    ReplyDelete
  16. It is very good and very informative. There is a useful information in it.Thanks for posting...
    https://www.apponix.com/

    ReplyDelete
  17. So, you want to do some practice in order to be prepared for the writing section of your English language test. If that's the case, take a look at the toefl essays topics where you are sure to find plenty practice material.

    ReplyDelete
  18. Natural herbs have cured so many illness that
    drugs and injection Can't cure. I've seen the great
    importance of natural herbs and the wonderful
    work they have done in people's lives. i read
    people's testimonies online on how they were
    cured of HIV, Hepatitis B, diabetics etc by DR JOHN
    herbal medicine, so i decided to contact
    the doctor because i know nature has the power
    to heal anything. I was diagnosed with Hepatitis B for the
    past 2 years but DR JOHN cured me with his
    herbs and i referred my aunt and her husband to
    him immediately because they were both
    suffering from herpes but to God be the glory,
    they were cured too .I know is hard to believe but
    am a living testimony. There is no harm trying
    herbs. He is also a spell caster, he cast spell to
    restore broken marriages and he cast good luck
    spells to prosper and excel in life. Contact DR JOHN on via email drjohnsoco@outlook.com, Phone whatsApp/+2348147766277

    ReplyDelete
  19. WOW MY HAPPY DAY oguduspellcast@gmail.com.or whatsApp number +13168440076 I am bold enough among many others to state that there is now a potent cure to this sickness but many are unaware of it. I discovered that I was infected with the virus 3 months ago, after a medical check-up. My doctor told me and I was shocked, confused and felt like my world has crumbled. I was dying slowly due to the announcement of my medical practitioner but he assured me that I could leave a normal life if I took my medications (as there was no medically known cure to Herpes). I went from churches to churches but soon found that my case needed urgent attention as I was growing lean due to fear of dying anytime soon. In a bid to look for a lasting solution to my predicament, I sought for solutions from the herbal world. I went online and searched for every powerful trade-medical practitioner that I could severe, cos I heard that the African Herbs had a cure to the Herpes syndrome. It was after a little time searching the web that I came across one Dr Ogudu (A powerful African Herbal Doctor), who offered to help me at a monetary fee. I had to comply as this was my final bus-stop to receiving a perfect healing. My last resolve was to take my life by myself, should this plan fail. At last it worked out well. He gave me some steps to follow and I meticulously carried out all his instructions. Last month, to be precise, I went back to the hospital to conduct another test and to my amazement, the results showed that negative,Dr Ogudu Can As Well Cure The Following Decease…Cancer,HIV,Herpes, Hepatitis B,Liver Inflammatory,Diabetes,Fibroid,Get Your Ex Back, You can free yourself of this Herpes virus by consulting this great African Herbal Doctor via this -mail:oguduspellcast@gmail.com.

    ReplyDelete
  20. Hi, I’ve been searching for help on how to get my ex lover back that broke up with me 2 years ago.. I was traumatised by the break up and nearly wanted to commit suicide but i thank God that i got the contact of dr oyimeanel the spiritual father that helped me to get back my ex lover after much searching of help from different places. When i got in touch with dr oyimeanel a, i explained everything to him to he gave me his words of encouragement and told me that he was going to prepare a spell for me that will help me get back my ex lover within 48 hours and i believed in his words for i was referred to him by a friend who he helped and right now, my ex lover is back and we are living happily together to get married next month. If you need any assistance whatsoever like getting cured from sickness, getting pregnant E.T.C. Then, I suggest that you get in touch with dr oyimeanel now through his Email ID: oyimeanelisiramen@gmail.com and WhatsApp him on+2348117963221 for more information. Thank you sir.

    ReplyDelete
  21. The post is very supportive as it helped me to solve numerous queries related to my assignment and I was so glad about the end result. I would recommend you guys to choose ganeshaspeaks for astrology.

    ReplyDelete
  22. Your blog provided with valuable information. thanks for this blog it's really helpful for students.
    Assignment Helper

    ReplyDelete
  23. Your information is very detailed and useful to me, thank you for sharing. I hope you will always be up to date. know about anveshi jain.

    ReplyDelete
  24. I am sharing this testimony to partners suffering in their relationships because there is an enduring solution.
    My husband left me and our 3 kids for another woman after 8 years. I tried to be strong just for my kids but I could not control the pains that torment my heart because it was too painful to bear. I was hurt and confused didnt know what to do I needed a help, so i did a research on the internet and came across a site where I saw that Dr UDI a spellcaster not just a spellcaster but a powerful one indeed and he can help get lovers back. I contacted him and he did a special prayer and spells for me and told me to go cool off wish i eventally did. To my greatest surprises, few days later, my husband came back home. what i taught was imposible became possible because of DR UDI. That was how we Became reunited again and renewed our vows and believe me there lot of love, joy and peace in the family.
    You can as well contact DR UDI, a powerful spell-caster for solutions on his contact Ultimatespellhome@gmail.com or via Whats App: +2348051243538

    ReplyDelete
  25. I will always keep on writing good and posting my testimonies about you on the Internet,I have been diagnosis with Parkinson for 3 yrs I was tested Parkinson positive,I lost hope and I wept all day,i needed to get cured on time so i was introduced by a blogger who also narrated Her story online on how she was cured of Parkinson by a herbal medication which was sent by Dr Ben i am totally free from Parkinson for anyone that may need the cure should contact Dr Ben on

    Benherbalcure@gmail.com
    Whatsapp him on +905385050893

    ReplyDelete
  26. Hey all, here is the detailed informative page about Sarkari Result Exams, a website which is well known for its genuine information about government jobs.
    Checkout each and every detail you want to inquire about the website.
    Thanks.

    ReplyDelete
  27. COEPD is glad to announce BA Internship Programs (Self sponsored) for professionals who want to have hands on experience. We are providing this program accompanied by IT Companies. Presently this program is available in Hyderabad & Pune locations. This internship is intelligently dedicated to our avid and passionate participants predominantly acknowledging and appreciating the fact that they are on the path of making a career in Business Analyst discipline. This internship is designed to ensure that in addition to gaining the requisite theoretical knowledge, the readers gain sufficient hands-on practice and practical know-how to master the nitty-gritty of the Business Analyst profession. More than a training institute, COEPD today stands differentiated as a mission to help you "Build your dream career" - COEPD way.

    https://www.coepd.com/business-analyst-training-internships.aspx

    ReplyDelete
  28. Hello Everyone out there,I am here to give my testimony about a Herbalist doctor who helped me . I was infected with HERPES SIMPLEX VIRUS in 2012, i went to many hospitals for cure but there was no solution, so I was thinking how can I get a solution out so that my body can be okay. One day I was in the river side thinking where I can go to get solution. so a lady walked to me telling me why am I so sad and i open up all to her telling her my problem, she told me that she can help me out, she introduce me to a doctor who uses herbal medication to cure HERPES SIMPLEX VIRUS and gave me his email, so i mail him. He told me all the things I need to do and also give me instructions to take, which I followed properly. Before I knew what is happening after two weeks the HERPES SIMPLEX VIRUS that was in my body got vanished . so if you are also heart broken and also need a help, you can also email him at {oliha.miraclemedicine@gmail.com}
    or whatsapp him number: +2349038382931.

    Contact him today and you will have a testimony...Good luck!

    ReplyDelete
  29. The example of a critique essay is the thing that can help you to write your amazing critique paper and fell like a true critic. Criticizing is art, so why not master your skills and create a masterpiece?

    ReplyDelete
  30. We at COEPD glad to announce that we have introduced Dot Net Technologies Internship Programs (Self sponsored) for professionals who want to have hands on experience. This program is available in COEPD Hyderabad premises which is accompanied by IT Companies. It is intelligently dedicated to our firm participants predominantly acknowledging and appreciating the fact that they are on the path of making a career in Dot Net Technologies discipline. We assume Object-Oriented Programming concepts and teaches C#.NET, ADO.NET which helps the interns to build database-driven Web applications and Web Sites successfully. This internship is designed to gain theoretical knowledge and also hands-on practice and practical know-how to master the nitty-gritty of the Dot Net developer profession. More than a training institute, COEPD today stands differentiated as a mission to help you "Build your dream career" - COEPD way.

    https://www.coepd.com/DotNet-Internship.aspx

    ReplyDelete
  31. My husband was once loving and caring but to a point he stopped and totally forsake me, he wasn't having time for me because he was having an affair, all he was, i was so devastated that i didn't know what to do. I did love him so much, even when he was still not caring and was cheating i couldn't leave cause i still loved him, i sorted for help from every where i could to have my husband back, i luckily found Robinson Buckler who was helping people out on relationship and marriage issues. I went on and contacted him, i explained what i was going through in my marriage, then he assured me that he would help me, i did all that he instructed me to do and then he told me that my husband would return to me after some days, i waited patiently and after some days passed my husband came home one evening and started apologizing to me to forgive him for how he had been treating me, i was so surprised beyond words that i can't thank this you enough. {{Robinsonbuckler@yahoo.com}} https://robinbuckler.com .....

    ReplyDelete
  32. Check our this website guys...Really awesome for assignmenthelp service in Australia. If any of your known or even you are looking for this service, then must try this website service. you will really like it.

    ReplyDelete
  33. Story of this blog is well written. The writer kept in consideration the grammar very well. Level of English also very well. Lot many new words has been used while writing content of this blog. Psychologist in Wynnum

    ReplyDelete
  34. Looking for assignment help at reasonable prices. Our online assignment help is of high quality without any sort of plagiarism so that they can score better grades always. Our assignment help Australia always submit assignments well before the deadline so students never need to worry about that and improve your knowledge too.

    ReplyDelete
  35. My husband was diagnosed of Parkinsons disease 2 years ago, when he was 49. He had a stooped posture, tremors, right arm does not move and also a pulsating feeling in his body. He was placed on Senemet for 8 months and then Siferol was introduced and replaced the Senemet, during this time span he was also diagnosed with d ementia. He started having hallucinations, lost touch with reality. Suspecting it was the medication I took him off the Siferol (with the doctor’s knowledge) and started him on PD natural herbal formula we ordered from AKANNI HERBAL CENTRE, his symptoms totally declined over a 3 weeks use of the AKANNI HERBAL Parkinsons disease natural herbal formula. He is now almost 51 and doing very well, the disease is totally reversed!  (Visit www. akanniherbalcentre .com)

    ReplyDelete
  36. Hello everybody I am here to show appreciation to Dr Robinson the great herbal doctor that help me got rid of my herpes virus which i contacted, And after so many search looking for medical cure to my illness which no medical doctor had cure to with no choice I was forced to share my pain to a friend who had bell's palsy and she directed me to this amazing herbal doctor with great powers who got her total cure and she assured me that Dr Robinson will help me get total rid of my herpes virus and f with the help of his herbal herbal cure and so surprising after taking his herbal treatment i  was totally cure and for 2 months now i have not experienced any symptoms i am so happy today to tell you all my story though it's cost me some money but I guarantee you he is one man you can contact for help and he will help you with his great powers. So if you have been looking for cure to whatever illness you are suffering from contact Dr Robinson by visiting his drrobinsonspellhome@gmail.com or call  and you will be glad you came to him for help for I strongly believe Dr Robinson will never fail in his herbal solutions . 

    ReplyDelete
  37. Hello everybody I am here to show appreciation to Dr Robinson the great herbal doctor that help me got rid of my herpes virus which i contacted, And after so many search looking for medical cure to my illness which no medical doctor had cure to with no choice I was forced to share my pain to a friend who had bell's palsy and she directed me to this amazing herbal doctor with great powers who got her total cure and she assured me that Dr Robinson will help me get total rid of my herpes virus and f with the help of his herbal herbal cure and so surprising after taking his herbal treatment i  was totally cure and for 2 months now i have not experienced any symptoms i am so happy today to tell you all my story though it's cost me some money but I guarantee you he is one man you can contact for help and he will help you with his great powers. So if you have been looking for cure to whatever illness you are suffering from contact Dr Robinson by visiting his drrobinsonspellhome@gmail.com or call  and you will be glad you came to him for help for I strongly believe Dr Robinson will never fail in his herbal solutions . 

    ReplyDelete
  38. Last year I started on COPD formula treatment from Akanni herbs foundation, the treatment worked incredibly for my lungs condition. I used the herbal treatment for almost 5 months, it reversed my chronic obstructive pulmonary disease. My severe shortness of breath, dry cough, low energy, fatigue, chest tightness and others gradually disappeared. Visit Akanni herbs foundation official web page www. akanniherbalcentre .com. This COPD treatment has improved the quality of my life greatly, i breath much better and feel comfortable doing so!

    ReplyDelete
  39. HOW I GOT CURED FROM HERPES VIRUS I was diagnosed of HERPES Virus and i have tried all to get my self free from this virus but I was unable to get cured from this Virus until I saw a post in a health forum about a herbalist man who prepare herbal medications to cure all kind of diseases including HERPES Virus At first I doubted if it was real but decided to give it a try,when I contacted this herbalist via his Email and he prepared a HERPES herbal cure and sent it to me via UPS delivery company service, when I received this herbal medicine, he gave me step by direction on how to apply it,after applying the way I was instructed,I was totally cured of this deadly disease called HERPES, All thanks to Dr. Sulani WhatsApp this great herbal doctor via on +2348118705388 or Email him via dr.sulaniherbalhome@gmail.com, you can also check his Email dr.sulaniherbalhome@gmail.com
    HE CAN ALSO CURE SICKNESS LIKE
    {1}HIV/AIDS
    {2}DIABETES
    {3}EPILEPSY
    {4} BLOOD CANCER
    {5} HPV{6} ALS
    {7} HEPATITIS
    {8}LOVE SPELL
    {9} SICKLE AND ANAEMIA..WhatsApp +2348118705388
    Email Address: dr.sulaniherbalhome@gmail.com

    ReplyDelete

  40. I was having Herpes Simplex Virus then i came across a review of people saying that they got treated from Herpes Simplex Virus by Dr Voke., So i gave a try by contacting him through his email and explain my problem to him. He told me all the things I need to do and also give me instructions to take, which I followed properly. Before I knew what is happening after two weeks the HERPES SIMPLEX VIRUS that was in my body got vanished . so if you are also heart broken by any deadly diseases like HERPES HIV, shingles,low sperm count or bringing back your ex lover, this great man is extremely the best in which I have seen and applauds and if you also need a help, you can also email him via email (doctorvoke@gmail.com)

    ReplyDelete
  41. Get instant assignment help sydney from top professionals in Australia...We are one of the best writing service providers over there. You can expect best from us and we will also leave no stone behind in providing you best...

    ReplyDelete
  42. This is a great way of presenting information. Very much quiet information and valuable. Thanks from 1377xx, 7star hd movies, 9x movies, aatmanirbhar bharat, online doctor consultation, bolly share hd.

    ReplyDelete
  43. Nice Blog !
    One such issue is QuickBooks Error 2107. Due to this error, you'll not be able to work on your software. Thus, to fix these issues, call us at 1-855-977-7463 and get the best ways to troubleshoot QuickBooks queries.

    ReplyDelete
  44. Wow!, thanks for sharing your ideas and especially for giving us priced features information.
    I love the way you balanced your views by still advocating. Well, for those of us that are still growing and does not have money to lose, your blog is really informative and helpful.

    Regards,
    Online Thesis Help

    ReplyDelete
  45. Order fresh flowers Online from best online florist in gurgaon. Send unique design flowers to gurgaon for all special occasions to your loved ones.

    send flowers to gurgaon

    ReplyDelete
  46. Send plants to Delhi - Order Unique plants Online from best gift shop, Gifola. Send latest unique plants to Delhi for all special occasions to your loved ones. ✓Free Home Delivery ✓Same Day Gift Delivery

    online plants delhi

    ReplyDelete
  47. I want to let the world know about Dr Osebor herbal cure he is 100% Guarantee sure to cure your. HIV/AIDS ,He is the only person that i can boldly say he can cure any types of Diseases.i was having HIV for more than 8 years when i meant Dr Osebor online on how he has cured so many people and how greatly he has helped many individuals online,so i contacted him and explained my situation to him and behold i was cure with his herbal medicine and now am living happily, so to anyone having issues on hiv/aids or other disease challenges i advised that you contacthim via email oseborwinbacktemple@gmail.com for whatsapp +2348073245515 he can also cure any disease such as(1) HIV/AIDS(2) HEPATITIS B,(3)DIABETICS,(4)CANCER,(5)HERPES(6)He can also bring back your ex lover,(7)LOVE SPELL,(7)PENIS ENLARGEMENT He is the great man and kind person. Dr Osebor thank you ones more for curing my HIV/AIDS, i own you in return. Thanks and be blessed Dr Osebor.

    ReplyDelete
  48. It is safe to say that you are upset from your day by day exhausting life? Is it true that you are need to invest some quality energy best darling on bed? It is safe to say that you are in Karachi? So the thing are you hanging tight for call us now 03053888832 for book Escorts in Lahore. Likewise we bargains in superstar accompanies in Lahore. call us now and invest your energy our call young ladies accompanies in luxuryescortslahore.com

    ReplyDelete
  49. I used to suffer from HERPES GENITAL for about 3 years so I can relate to people who have the cure. No medications or treatments ever really did anything for me (i tried them all no one worked. but I was actually able to completely cure HERPES naturally after countless hours of online research. What worked for me is as follows: I saw  Dr Oje Abacha Information online that he normally cure and treat disease and infirmities with his Herbal Medicine, I never really believed the people who were recommending him thou i saw on blog about 6 people where also testifying on how they were cured by Dr Oje Abacha and stillEllen recommend Dr Oje Abacha who uses herbal medication to cure HERPES GENITAL VIRUS and gave me his email, so i mail him He told me all the things I need to do and also give me instructions to take, which Followed properly. Before I  didn"t know what was happening after two weeks the Herpes GENITAL VIRUS that were in my body got vanished . so if you are also heart broken and also need a help, you can also email him: oje.herbalsolutioncentre@gmail.com . or WhatsApp   him on +2349050957732 if you are infected with any disease like HIV,AIDS,CANCER,LOVE SPELL, HERPES.PVC, or any other disease you can also be happy like me by contacting.....Name: Dr Oje Abacha His website  https://ojeherbalsolutioncentre.wordpress.com     

    ReplyDelete
  50. Hello, this is to everyone out there with different health challenges, as I know there are still many people suffering from different health issues and are therefore looking for a solution. I bring you Good news. A man called Dr.Williams a herbal practitioner who helped cure Genital herpes, I had suffered for the past 2years and spent so much money trying to survive. I got my healing by taking the herbal medicine he sent to me to drink for about 18 days, 7 days after completion of the dosage, I went for a medical checkup and I was tested Genital Herpes NEGATIVE. I’m sharing this so that other people can know of this great healer called Herbalist Dr. Williams because I got to know him through a friend he cured of HIV. I was made to understand that he can cure several other deadly diseases and infections. Don’t die in ignorance and don’t let that illness take your life. You can contact him via his email as; (drwilliamscure@gmail.com,) or WhatsApp number +2347040461868, Website:https://drwilliamscure.wixsite.com/herbalhome

    ReplyDelete
  51. Am here to testify about the miraculous work of a great traditional doctor called Dr. Kham.....I have been suffering from Herpes Virus since the last 2 years but today I am happy that I am cured from it with the herbal medicine made by Dr. Kham the great healer, I was browsing the internet searching for the possible cure when I came across a testimony shared by someone on how Dr. Kham cured her from Herpes Disease. I quickly contacted him to get the cure and today i am now free from the Virus, I am so much happy today that we have someone like this great healer out there, so people out there kindly contact this great doctor on his email address please sir keep your good work cause there are people out there who is in need of your healing medicine .please in contact with him with this information,
    .
    .
    *EMAIL*..... dr.khamcaregiver@gmail.com

    *WHATSAPP/CALL*...... +2348159922297

    *WEBSITE*......https://drkhamcaregiver.wixsite.com/drkhamcaregiverherba

    *FB PAGE*.........https://web.facebook.com/Dr-Kham-Herbal-Remedies-101547721440460/

    I assure you that Dr. Kham can prepare Herbal medicine for all kinds of diseases like,, HIV, CANCER, HEPATITIS B, DIABETES, COLD SORES, SYPHILIS. HBV, HPV, AND ANY OTHER STDs, Contact Dr. Kham to get your healing Today.

    ReplyDelete
  52. The Programming Homework Help service was worth more than every penny I paid for it. Thanks a bunch for giving me their time and dedication. I loved every bit of the experience I had with one of the Java Homework Help experts, who turned out to be very interactive and professional in the way she handled me and my assignment. The lady was experienced and polite. Thanks, too, for the affordable prices and easy payment process. I'll come again for more.

    ReplyDelete
  53. This Statistics Assignment Help provider has been completing my assignments and helping me understand them at the same time. That is, as soon as he submits the assignment's solutions, he commits himself to explain each of them to me on a video call. I always use this service to achieve perfect presentations and understand more concepts for future use in the examinations. Besides, the Statistics Homework Help specialist is a good advisor. He's generous with sharing his experience with students.

    ReplyDelete
  54. Java isn't my cup of tea, but I'm confident that the Programming Assignment Help services are going to make a difference. I'm waiting for their solutions for the firstC++ Homework Help order that I've just sent. I believe that they're going to help me pass and understand some of the major concepts of the programming language.

    ReplyDelete
  55. Looking for a master’s levelMatlab homework help solver. I am starting my image processing project but I don’t have time for it. I want aMatlab assignment help expert who will work on it from start to finish. Our professors like it worked step by step so that they can check and return comments for corrections. The tutor I want will be receiving the comments, correcting them, and then returning them to the professor. Once they are corrected and given a go-ahead to continue the tutor will then go ahead to the next chapter until the project is completed. Let me know whether they have someone who can do that.

    ReplyDelete
  56. How can I be sure that they will complete my assignment on time? I have fallen into the hands of fakeEconomics assignment help experts so many times. I am now looking for a genuineEconomics homework help expert who is ready to partner with me for the next 2 years. I would appreciate it if you send me their samples to see the quality of your work

    ReplyDelete
  57. Greetings to everyone reading this testimony,am here to
    testify of a great man who was able to cure me permanently from herpes
    Disease just with his herbal medicine,i have been herpes Positive for 5
    years before i came across Dr voodoo Email on the internet on how he has
    been using his herbal medicine to treat and cure patients from different
    virus, so i contacted him and i explain to him concerning my problem, i
    followed up with the instructions he gave me and he urge me to have faith
    in his words that he was going to restore my health back, after some couple
    of days Dr voodoo sent me some medicine which he gave me prescription on
    how to take for 2 weeks, to make the long story short, I have been
    confirmed Negative from my recent test in the hospital, just within 2 weeks
    Dr voodoo was able to make me healthy and see reasons to live again, though
    science says there is no cure, i believe God has sent this great man to
    save people, you can all contact him for his medicine, he has presently
    been treating diseases like,CANCER,BLOOD DISEASE,DIABETES,HIV,TYPHOID, and
    many others, you can contact this man on voodoospelltemple66@gmail.com.or
    add him on whatsApp +2348140120719, God Bless you sir!

    ReplyDelete
  58. Dr agbadu A very big thanks to you and your entire staff, to be honest with you, at first I was skeptical but I had to talk to you about my situation because I’ve done everything possible for me to get cured, and the doctors doesn’t make us believe there is a cure. I did exactly what you said, i took the medicine for some weeks just the way you instructed that I supposed to and my Hsv1 and 2 is gone. Now I’m free with no side effects or whatsoever. I really appreciate you and your entire staff, for the good thing you all have done in my life, Indeed you are a great healer, Once again thanks and God bless. dragbadu@gmail.com whatsapp him on +2349038986741

    ReplyDelete
  59. I have been suffering from (HERPES) disease since last year without hope for cure and i was miserable until this year i was checking on new developments about this virus then i saw how different persons talks about getting cure for herpes through a particular herbalist called Dr.Agbadu so I email him (dragbadu@gmail.com) and he responded with. instructions about what he needs to prepare the herbal medication which i did and he sent it to me in LA and after taking the herbal medicine as he instructed i went back to the hospital few days later and the test result shows i,m negative and now i,m completely free of Herpes, thanks to Dr.Agbadu for his urgent response, you can call or whats-app his personal cell phone number +2349038986741 Contacted him through

    ReplyDelete
  60. I have been suffering from (HERPES) disease since last year without hope for cure and i was miserable until this year i was checking on new developments about this virus then i saw how different persons talks about getting cure for herpes through a particular herbalist called Dr.Agbadu so I email him (dragbadu@gmail.com) and he responded with. instructions about what he needs to prepare the herbal medication which i did and he sent it to me in LA and after taking the herbal medicine as he instructed i went back to the hospital few days later and the test result shows i,m negative and now i,m completely free of Herpes, thanks to Dr.Agbadu for his urgent response, you can call or whats-app his personal cell phone number +2349038986741 Contacted him through...

    ReplyDelete
  61. Hello viewers I am glad to have met with the powerful herbal healer called
    Dr voodoo who use his herbs to cure my HIV disease I suffered from 15years,
    but now I am a happy woman and i am free from this sickness that has been
    problem to my living, after using Dr voodoo herbal medicine within 1week i
    was diagnose negative, I will recommend Dr voodoo to everyone reading this
    article because this herbal healer is capable to heal anything, the
    scientist said has no cure, Email him : voodoospelltemple66@gmail.com or
    add Dr voodoo on whatsApp: +2348140120719

    ReplyDelete
  62. Get the best Programming Assignment Help from Expert of BookMyEssay.

    ReplyDelete