Sunday, April 3, 2016

How to train undergraduate psychologists to be post hoc BS generators

Teaching undergraduate psychology is difficult for a variety of reasons. Students come in with preconceived notions about what psychological research is and are sometimes disappointed with the mismatch between their preconceptions and reality. Much of what psychologists do is highly specialized and requires skills that are difficult to teach, and psychologists-in-training can't offer much research-wise until they have years of experience. The assignments we ask undergraduates to complete are meant to train their critical thinking skills to prepare them for a more substantive contribution to research. Sometimes, however, they do exactly the opposite; instead, assignments can reward post hoc BS generation rather than actual critical thinking.



If the recent so-called crisis in psychology has highlighted anything, it is the prevalence and danger of post hoc narratives. Although statistical practices (e.g., use if significance testing) have gotten much of the blame -- at least in my corner of the research world -- the main problems are actually a level or two above that. Combining ill- or flexibly-defined theoretical concepts, post hoc reasoning, and publication bias yields a potent mixture that I would argue is responsible for the crisis.

I have been thinking about this in the context of assignments that we ask our undergraduates to do, and how we actually train post hoc reasoning early on. Here I'll offer examples of two undergraduate assignments that I think reward scientists-in-training for their BS generation skills. I'll also elaborate on what I think we can do about this.
The "Texas Sharpshooter" paints the target around his bullet holes.

Example assignment: Critique a peer-reviewed article

The assignment: Students are assigned an article from a peer-reviewed psychological journal and asked to critique it. Ideally, they develop choose a few critiques for which they argue for in their essay.

The basic problem with this assignment is that students are not particularly well-versed in any particular psychological topic, nor in psychological research methods. On the other hand peer-reviewed articles have been reviewed by people who are, which means that whatever problems remain with the research have evaded skilled reviewers. This is not to say that peer-reviewed research does not have major problems, but it does mean that students who have had only a few basic courses and do not have much experience in reading peer-reviewed research are unlikely to be able to find good quality-critiques spontaneously.

Upon reading such an article and having difficulty find a critique, a student is in an awkward position: they must write an essay. So what do they do? They come up with whatever critiques come to mind, which are likely to be low-quality critiques. I suspect readers of this blog have experienced these sorts of critiques in student assignments: maybe there are cultural differences? The sample seems small. Are these really the best stimuli to use? They must choose a number of these arguments, and argue for them, in spite of the fact that they don't have sufficient knowledge on which to base such a critique. We're training them in the fine art of bullshit.

This is not to say that these problems don't occur in some studies. But forming a good argument why takes specialized knowledge they they don't yet have, so we get back noise from the students. And who gets the best marks for such an assignment? Students who can write clearly about things of which they have little actual understanding.

We have to ask ourselves: is it any wonder that we have a replication crisis?

Example assignment: Do an experiment and interpret the results

The assignment: Students are asked to perform a simple experiment (often in groups), analyze the data, and report the results. They must interpret the results in light of the research they've read (often primarily the textbook).

Experience doing simple experiments and analyzing the results is critical to a psychologist-in-training. But how the assignment is framed and marked is critical to whether we are training the skills we want. Students in chemistry, biology, and physics all perform easy experiments and report the results; this is as it should be.

What is different about interpreting the results of a typical psychology experiment and that of a chemistry experiment is that there are very strong reasons to expect something specific to happen in the chemistry experiment. If the psychology experiment doesn't come out as the textbook predicts, though, they must describe why that might be. There are, of course, a hundred possible reasons why this might be the case, including the possibility that the original study was wrong, statistical noise, and sloppiness in their experimental procedure.

But these explanations will not be the ones they will explore. We require students to show creativity and independent reading/thought. In an assignment like this, students know that the best way to get a good mark is to find a paper whose logic might predict the results obtained, and include a cogent argument why this might have caused the differences. The students turn in the paper, and will not test their hypothesis, of course; the argument is simply thrown in to get a better mark. The students who do the most independent reading and form the best-sounding argument will get the best mark.

This should all sound eerily familiar: we are training them in the time-honored tradition of post hoc arguments for "hidden moderators".

Fixing the problems

If we want to train good psychologists, we must be very sensitive to the skills we're actually teaching, as opposed to those we think we are teaching. The practices in the field will be a reflection of what students are taught. How might we use assignments to train critical thinking, without teaching bad practice?

Critiquing pop science

The problem with the critique of the peer-reviewed article is that students are unlikely to be able to spot the real problems with the article. This is somewhat like asking first-year sports therapists to critique a professional sports player's technique; the imperfections are simply too fine, because the professionals have been honing their craft with help for years. It would be better to ask them to critique amateur sports players' techniques, because they will have more glaring problems.

Unfortunately, there is no "amateur" peer-reviewed research. There is, however,  a lot of very bad non-peer-reviewed pop science. Psychologists-in-training would benefit from assessing bad popular science (not just popular psychology) assessing, for instance, spurious claims of causation (vs correlation), overblown effect sizes, and mismatches between what is claimed about a research in a pop article versus what was actually done. Critiquing popular science develops the similar skills as critiquing a peer-reviewed article, without the unfortunate side effect of asking students to BS their way to a good mark.


Separating critiques of method from critiques of results

Critiquing methods along side of the results leads to the unfortunate asymmetry that if an experiment yields the expected result, the methods are not critiqued, whereas if it doesn't, the students are encouraged to generate BS reasons why it might not work, with no expectation of testing those reasons. If students were asked to critique methods by themselves, then they would not be rewarded for such post hoc reasoning. Moreover, in an essay of typical length, this leaves more room to discuss reasons why the methods are problematic; for instance, if the sample size is problematic, a methods-only critique would allow space for a power analysis. In a methods+results critique, I often see critiques of sample sizes with no corresponding argument why the sample size is a problem.


Being specific about potential critiques

In whatever assignments we give to undergraduates, we should be specific about what sorts of critiques we are expecting, preferably giving a short list of possible critiques. The students will still have to read the target article, but instead of giving a shot in the dark and being forced to argue for it, students will be forced to ask, for instance, "Does this research suffer from a confound with X?", or "is this experiment sufficiently powered to detect an effect size of Z?" or "Does this DV represent a good operationalization of W?"

Perhaps, for instance, power is not a problem; they would then be in a position to argue that, yes, the experiment is sufficiently powered, instead of always (vaguely) attacking an article. Always asking for critique teaches the students that critical thinking is about dreaming up as many ways to attack an article as possible, and then forming a plausible-seeming argument around them. In contrast, being very specific about possible critiques -- that may not, in fact, turn out to be problems -- will develop critical thinking and argumentation skills better.

Wrap up

If we believe psychology is in crisis, we should look at the way we train undergraduates to see if part of the problem lies there. I think the crisis in psychology is reflected in some ways in our training. Doing better is not just about better statistical training or better open science training; it is also about ensuring a match between what we think we are teaching and what we actually teach. 

38 comments:

  1. By definition, if you pick a random article from the literature then the remaining problems are those that the reviewers didn't spot, but one might expect those errors to have some sort of distribution, and there will be some fun to be had in the right-hand tail of that distribution. So I don't see that there is necessarily a problem with critiquing an article, as long as it is carefully chosen to be a bad one with an interesting selection of deficiencies, some more obvious than the others.

    Perhaps a bigger problem is the Dodo bird approach to marking such assignments, in which the student who actually nails the critical problem will probably not get a much better mark than the one who merely asks vague questions about culture or sample size. But I'm not sure that this is much of a problem, because (it seems to me, but perhaps I'm just being hopeful) the majority of those in the latter category are not going on to be researchers anyway.

    ReplyDelete
    Replies
    1. I agree that there are articles out there that might be used for this purpose; I think, though, that these articles are hard-ish to find because they have to be really bad. If you've got to find a new one every year, that's going to be a tall order for a single lecturer.

      Even if you do find such an article, for undergraduate pedagogy, it pays to be specific about what sorts of problems you might be looking for (and to throw some issues into the mix that are not problematic, so they'll learn not to attack everything in sight).

      Delete
    2. Students can't be expected to learn from critiquing real articles because it's too hard, because they don't know how to critique real articles? ;)

      I agree with most of the elements here, especially specificity, but feel it's kind of getting it backwards. There's no such thing as an article so apt for learning methodology that you can just throw it at students with an essay instruction and expect more than a small fraction to successfully re-invent the methodological wheel, or even to make meaningful progress. And even if there was, it wouldn't stay that way for very long.

      It's not the material. Students need clear expectations, and they need to see how it's done first. Not perfectly, but good enough, before they're ready to start attempting for themselves. Then, they need active and specific feedback (not "four weeks after" feedback). People who do internships get those things, so they learn to DO science, not just ABOUT science. Many professors, in my experience, deny students that basic, critical scaffold during their classes, partly due to time constraints, but also deliberately in pursuit of some vague ideal of teaching them about "thinking for yourself." (It's never quite clear exactly what is meant by this, but by golly, its status as a universal good is beyond reproach and I am offended you'd even think to question it.)

      This is a massive mistake. I sure know I had to learn from listening directly to and interacting with people like you pick apart papers, concepts and ideas, and try to understand your reasoning, before I was ready to try for myself. Although, of course, the quality of my learning is arguable.

      Delete
    3. TESTIMONY FROM ANSU{SAUDI ARABIA}
      I want to share my testimony about my HIV virus that was cured by a herbalist Dr Ogugu with his roots and herbs,Since last 4 years I have being a HIV AID patient. I never think I will live long again and am so grateful about Dr Ogugu who cured my HIV AIDS last week. I was in pains so I told one of my friend and she told me that there is a herbalist that can cure my HIV with his roots and herbs. do contact him now she read someone testimony from a website online on how Dr Ogugu cure her from HIV AIDS and she also collected Dr Ogugu website and email. She gave me the contact info, I emailed him and he prepared herbal medicine for me with his roots and herbs, after two weeks he ask me to go for a test. Which I did, when the doctor told me that am now a HIV negative patient I couldn't believe myself I went to see another doctor and the result was still the same, Thank God everything is fine, I'm cured by Dr Ogugu with his herbal medicine, I'm very thankful to Dr Ogugu and very happy with my family.Dr Ogugu can also offer any types of help like Curing of all types of Diseases and lot's more.

      Whatsapp/ call: +2348081594908
      Email: Oguguspellcaster@gmail.com
      Web Page: https://oguguspellcaster.wixsite.com/spell

      Delete
    4. I will always keep on writing good and posting my testimonies about you on the Internet,I have been diagnosis with Parkinson for 3 yrs I was tested Parkinson positive,I lost hope and I wept all day,i needed to get cured on time so i was introduced by a blogger who also narrated Her story online on how she was cured of Parkinson by a herbal medication which was sent by Dr Ben i am totally free from Parkinson for anyone that may need the cure should contact Dr Ben on

      Benherbalcure@gmail.com
      Whatsapp him on +905385050893

      Delete
  2. Thank you for this! I would have loved to see this post as an undergraduate, speaking as a rather good 'can write clearly about things of which they have little actual understanding' type of student, or at least a discussion on the subject during my studies. One of the benefits of these 'critique' assignments has, for my generation, been promoting creative writing, and some of my colleagues actually landing journalist(ic) jobs. Fixing problems was never a big part of the curricula, which is odd, and let me explain why. I'm a graduate student at a university where you can get a 'psychology' degree (MA), meaning there are no more or less scientific-focused, or practice-focused programs. Most of my colleagues, and any of the university's critics would probably call for more practical knowledge in terms of work-related practice, especially since the statistical and methodological subjects represent a fair amount of the program, which seems pretty 'scientific'. But here's the catch: important issues like these are never discussed with most of the students, since it's expected that only a few (if so) will want or get to the doctorate program, and eventually probably stay as employees. These issues are tackled at the doctorate level, and the rest of us only have to 'survive' writing our one thesis, with most of us ending up in areas we were never interested in - and I have to say - with work bringing little to none value to the 'real' scientific body of knowledge. With the risk of sounding like a victim here, it seems that this is just another demotivating mechanism for us 99% of non-doctorate students. I have to agree with Chistian H. on learning by listening to people like you, and the internships part, only in my case it's the stay-as-TA's people. I'm fortunate in having a mentor for my thesis with similar interests, so I do get great and prompt feedback, plus he teaches a couple of classes which are basically online discussion forums, so there are some improvements. Still, it was clear from day one - I was never going to stay as a TA, so there's really no point in bothering me with all that extra knowledge.

    ReplyDelete
  3. This comment has been removed by a blog administrator.

    ReplyDelete
  4. It’s a shame you don’t have a donate button! I’d certainly donate to this brilliant blog! I suppose for now i’ll settle for book-marking and adding your RSS feed to my Google account. I look forward to fresh updates and will talk about this blog with my Facebook group. Chat soon!
    _________________________
    Video player for Mac

    ReplyDelete
  5. I once had the "luck" of being made co-author on a very bad paper, and for reasons beyond the scope of this reply I decided not to retract my authorship. This enabled me to give students that paper, with the mission of finding at least 3 glaring errors, and teaching them to do so even if the teacher is one of the co-authors.

    ReplyDelete
  6. Really your article was full of quality word with good structure thanks for share it critiquing qualitative research.

    ReplyDelete
  7. Hi, very nice blog. hire virtual assistant from marhaba reception and you will never be disappointed. We are among the virtual office assistant and offer some of the best services.

    ReplyDelete


  8. Thank you for your post. This is excellent information. It is amazing and wonderful to visit your site.
    Oracle Reseller servies in north america

    ReplyDelete
  9. COEPD LLC- Center of Excellence for Professional Development is the most trusted online training platform to global participants. We are primarily a community of Business Analysts who have taken the initiative to facilitate professionals of IT or Non IT background with the finest quality training. Our trainings are delivered through interactive mode with illustrative scenarios, activities and case studies to help learners start a successful career. We impart knowledge keeping in view of the challenging situations individuals will face in the real time, so that they can handle their job deliverables with at most confidence.

    http://coepd.us/

    ReplyDelete
  10. Irrespective of receiving daily oral or future injectable depot therapies, these require health care visits for medication and monitoring of safety and response. If patients are treated early enough, before a lot of immune system damage has occurred, life expectancy is close to normal, as long as they remain on successful treatment. However, when patients stop therapy, virus rebounds to high levels in most patients, sometimes associated with severe illness because i have gone through this and even an increased risk of death. The aim of “cure”is ongoing but i still do believe my government made millions of ARV drugs instead of finding a cure. for ongoing therapy and monitoring. ARV alone cannot cure HIV as among the cells that are infected are very long-living CD4 memory cells and possibly other cells that act as long-term reservoirs. HIV can hide in these cells without being detected by the body’s immune system. Therefore even when ART completely blocks subsequent rounds of infection of cells, reservoirs that have been infected before therapy initiation persist and from these reservoirs HIV rebounds if therapy is stopped. “Cure” could either mean an eradication cure, which means to completely rid the body of reservoir virus or a functional HIV cure, where HIV may remain in reservoir cells but rebound to high levels is prevented after therapy interruption.Dr Itua Herbal Medicine makes me believes there is a hope for people suffering from,Parkinson's disease,Schizophrenia,Cancer,Scoliosis,Fibromyalgia,Fluoroquinolone Toxicity
    Syndrome Fibrodysplasia Ossificans Progressiva.Fatal Familial Insomnia Factor V Leiden Mutation ,Epilepsy Dupuytren's disease,Desmoplastic small-round-cell tumor Diabetes ,Coeliac disease,Creutzfeldt–Jakob disease,Cerebral Amyloid Angiopathy, Ataxia,Arthritis,Amyotrophic Lateral Sclerosis,Alzheimer's disease,Adrenocortical carcinoma.Asthma,Allergic diseases.Hiv_ Aids,Herpes,Inflammatory bowel disease ,Copd,Diabetes,Hepatitis,I read about him online how he cure Tasha and Tara so i contacted him on drituaherbalcenter@gmail.com even talked on whatsapps +2348149277967 believe me it was easy i drank his herbal medicine for two weeks and i was cured just like that isn't Dr Itua a wonder man? Yes he is! I thank him so much so i will advise if you are suffering from one of those diseases Pls do contact him he's a nice man.

    ReplyDelete
  11. My life is beautiful thanks to you, Mein Helfer. Lord Jesus in my life as a candle light in the darkness. You showed me the meaning of faith with your words. I know that even when I cried all day thinking about how to recover, you were not sleeping, you were dear to me. I contacted the herbal center Dr Itua, who lived in West Africa. A friend of mine here in Hamburg is also from Africa. She told me about African herbs but I was nervous. I am very afraid when it comes to Africa because I heard many terrible things about them because of my Christianity. god for direction, take a bold step and get in touch with him in the email and then move to WhatsApp, he asked me if I can come for treatment or I want a delivery, I told him I wanted to know him I buy ticket in 2 ways to Africa To meet Dr. Itua, I went there and I was speechless from the people I saw there. Patent, sick people. Itua is a god sent to the world, I told my pastor about what I am doing, Pastor Bill Scheer. We have a real battle beautifully with Spirit and Flesh. Adoration that same night. He prayed for me and asked me to lead. I spent 2 weeks and 2 days in Africa at Dr Itua Herbal Home. After the treatment, he asked me to meet his nurse for the HIV test when I did it. It was negative, I asked my friend to take me to another nearby hospital when I arrived, it was negative. I was overwhite with the result, but happy inside of me. We went with Dr. Itua, I thank him but I explain that I do not have enough to show him my appreciation, that he understands my situation, but I promise that he will testify about his good work. Thank God for my dear friend, Emma, I know I could be reading this now, I want to thank you. And many thanks to Dr. Itua Herbal Center. He gave me his calendar that I put on my wall in my house. Dr. Itua can also cure the following diseases ... Cancer, HIV, Herpes, Hepatitis B, Inflammatory Liver, Diabetis, Fribroid,Parkinson's disease,Inflammatory bowel disease ,Fibromyalgia, recover your ex. You can contact him by email or whatsapp, @ .. drituaherbalcenter@gmail.com, phone number .. + 2348149277967 .. He is a good doctor, talk to him kindly. I'm sure he will also listen to you.

    ReplyDelete
  12. Great blog is this and It have good information. On this November enjoy and get advantage of Black Friday and Cyber Monday Deals specially Victorias Secret Body Lotions Deals Black Friday .

    ReplyDelete
  13. I am bold enough among many others to state that there is now a potent cure to this sickness but many are unaware of it. I discovered that I was infected with the virus 3 months ago, after a medical check-up. My doctor told me and I was shocked, confused and felt like my world has crumbled. I was dying slowly due to the announcement of my medical practitioner but he assured me that I could leave a normal life if I took my medications (as there was no medically known cure to Herpes). I went from churches to churches but soon found that my case needed urgent attention as I was growing lean due to fear of dying anytime soon. In a bid to look for a lasting solution to my predicament, I sought for solutions from the herbal world. I went online and searched for every powerful trado-medical practitioner that I could severe, cos I heard that the African Herbs had a cure to the Herpes syndrome. It was after a little time searching the web that I came across one Dr Itua(A powerful African Herbal Doctor), who offered to help me at a monetary fee. I had to comply as this was my final bus-stop to receiving a perfect healing. My last resolve was to take my life by myself, should this plan fail. At last it worked out well. He gave me some steps to follow and I meticulously carried out all his instructions. Last month, to be precise, I went back to the hospital to conduct another test and to my amazement, the results showed that negative,Dr Itua Can As Well Cure The Following Desease…Cancer,Hiv,Herpes, Hepatitis B,Liver Inflammatory,Diabetis,Fribroid,,Non Hodgkin Lymphoma,Skin Cancer,Uterine Cancer,Prostate Cancer Dercum,Infertility,fibromyalgia,Get Your Ex Back,Als,SYPHILLIS,Genetic disease,Epilepsy, Parkinson's disease..You can free yourself of this Herpes virus by consulting this great African Herbal Doctor via this e-mail: drituaherbalcenter@gmail.com or call and whatsapp him on +2348149277967 He will help you and his herb medication is sure. he has the cure on all disease .You can talk to me on INSTAGRAM..tashamoore219....

    ReplyDelete

  14. Hello,
    My name is sophia miller.
    thanks for this information.
    Get the best Finance Assignment Help anytime.

    ReplyDelete
  15. I am bold enough among many others to state that there is now a potent cure to this sickness but many are unaware of it. I discovered that I was infected with the virus 3 months ago, after a medical check-up. My doctor told me and I was shocked, confused and felt like my world has crumbled. I was dying slowly due to the announcement of my medical practitioner but he assured me that I could leave a normal life if I took my medications (as there was no medically known cure to Herpes). I went from churches to churches but soon found that my case needed urgent attention as I was growing lean due to fear of dying anytime soon. In a bid to look for a lasting solution to my predicament, I sought for solutions from the herbal world. I went online and searched for every powerful trado-medical practitioner that I could severe, cos I heard that the African Herbs had a cure to the Herpes syndrome. It was after a little time searching the web that I came across one Dr Itua(A powerful African Herbal Doctor), who offered to help me at a monetary fee. I had to comply as this was my final bus-stop to receiving a perfect healing. My last resolve was to take my life by myself, should this plan fail. At last it worked out well. He gave me some steps to follow and I meticulously carried out all his instructions. Last month, to be precise, I went back to the hospital to conduct another test and to my amazement, the results showed that negative,Dr Itua Can As Well Cure The Following Desease…Cancer,Hiv,Herpes, Hepatitis B,Liver Inflammatory,Diabetis,Fribroid,,Non Hodgkin Lymphoma,Skin Cancer,Uterine Cancer,Prostate Cancer Dercum,Infertility,fibromyalgia,Get Your Ex Back,Als,SYPHILLIS,Genetic disease,Epilepsy, Parkinson's disease..You can free yourself of this Herpes virus by consulting this great African Herbal Doctor via this e-mail: drituaherbalcenter@gmail.com or call and whatsapp him on +2348149277967 He will help you and his herb medication is sure. he has the cure on all disease .You can talk to me on INSTAGRAM..tashamoore219....

    ReplyDelete
  16. I have long felt a special connection with Herbal Medicine. For one thing is natural, Charlie we went to the same small college in Southern California — Claremont Men’s College — though he dropped out and ultimately enrolled at the Julliard School of the Performing Arts in New York. Had he stayed at Claremont, he would have been a senior the year I started there; I have often kidded that I was the reason he left when he finds out I had herpes. So my life have been lonely like hell all day I couldn't bear the outbreak pain, Tasha then introduce me to Dr Itua who use his herbal medicine to cure her two weeks of drinking it. I place an order form him and he delivers to my post office then I picked it up and used for two weeks all my sore was healed completely no more outbreak I'm honestly telling you this man is a great man, I trust him and his herbal medicine so much I'm sharing this to show my appreciation also to let sick people know there is hope with Dr Itua Herbal Made Medicine.Dr Itua Contact Email.drituaherbalcenter@gmail.com,Whatsapp.+2348149277967
    He cures.
    Herpes,
    STROKE.
    Hepatitis
    H.P.V TYPE 1 TYPE 2 TYPE 3 AND TYPE 4. TYPE 5.
    HIV
    SYPHILIS.
    Liver/Kidney Inflammatory
    Epilepsy

    ReplyDelete
  17. TESTIMONY FROM MARY SMITH{UK}
    I am here to give my testimony about Dr Ogugu who helped me in my life, i want to inform the public how i was cured from (HERPES SIMPLEX VIRUS) by Dr Ogugu,i visited different hospital but they gave me list of drugs like Famvir, Zovirax, and Valtrex which is very expensive to treat the symptoms and never cured me. I was browsing through the Internet searching for remedy on HERPES and i saw comment of people talking about how Dr Ogugu cured them. when i contacted him he gave me hope and send a Herbal medicine to me that i took and it seriously worked for me, am a free person now without problem, my HERPES result came out negative. I pray for you Dr Ogugu am cured you can also get your self cured my friends if you really need my doctor help, you can reach him now:

    Whatsapp/ call: +2348081594908
    Email: Oguguspellcaster@gmail.com
    Web Page: https://oguguspellcaster.wixsite.com/spell

    ReplyDelete
  18. It is very good and very informative. There is a useful information in it.Thanks for posting...
    https://www.apponix.com/

    ReplyDelete
  19. So, you want to do some practice in order to be prepared for the writing section of your English language test. If that's the case, take a look at the toefl essays topics where you are sure to find plenty practice material.

    ReplyDelete
  20. Natural herbs have cured so many illness that
    drugs and injection Can't cure. I've seen the great
    importance of natural herbs and the wonderful
    work they have done in people's lives. i read
    people's testimonies online on how they were
    cured of HIV, Hepatitis B, diabetics etc by DR JOHN
    herbal medicine, so i decided to contact
    the doctor because i know nature has the power
    to heal anything. I was diagnosed with Hepatitis B for the
    past 2 years but DR JOHN cured me with his
    herbs and i referred my aunt and her husband to
    him immediately because they were both
    suffering from herpes but to God be the glory,
    they were cured too .I know is hard to believe but
    am a living testimony. There is no harm trying
    herbs. He is also a spell caster, he cast spell to
    restore broken marriages and he cast good luck
    spells to prosper and excel in life. Contact DR JOHN on via email drjohnsoco@outlook.com, Phone whatsApp/+2348147766277

    ReplyDelete
  21. WOW MY HAPPY DAY oguduspellcast@gmail.com.or whatsApp number +13168440076 I am bold enough among many others to state that there is now a potent cure to this sickness but many are unaware of it. I discovered that I was infected with the virus 3 months ago, after a medical check-up. My doctor told me and I was shocked, confused and felt like my world has crumbled. I was dying slowly due to the announcement of my medical practitioner but he assured me that I could leave a normal life if I took my medications (as there was no medically known cure to Herpes). I went from churches to churches but soon found that my case needed urgent attention as I was growing lean due to fear of dying anytime soon. In a bid to look for a lasting solution to my predicament, I sought for solutions from the herbal world. I went online and searched for every powerful trade-medical practitioner that I could severe, cos I heard that the African Herbs had a cure to the Herpes syndrome. It was after a little time searching the web that I came across one Dr Ogudu (A powerful African Herbal Doctor), who offered to help me at a monetary fee. I had to comply as this was my final bus-stop to receiving a perfect healing. My last resolve was to take my life by myself, should this plan fail. At last it worked out well. He gave me some steps to follow and I meticulously carried out all his instructions. Last month, to be precise, I went back to the hospital to conduct another test and to my amazement, the results showed that negative,Dr Ogudu Can As Well Cure The Following Decease…Cancer,HIV,Herpes, Hepatitis B,Liver Inflammatory,Diabetes,Fibroid,Get Your Ex Back, You can free yourself of this Herpes virus by consulting this great African Herbal Doctor via this -mail:oguduspellcast@gmail.com.

    ReplyDelete
  22. Hi, I’ve been searching for help on how to get my ex lover back that broke up with me 2 years ago.. I was traumatised by the break up and nearly wanted to commit suicide but i thank God that i got the contact of dr oyimeanel the spiritual father that helped me to get back my ex lover after much searching of help from different places. When i got in touch with dr oyimeanel a, i explained everything to him to he gave me his words of encouragement and told me that he was going to prepare a spell for me that will help me get back my ex lover within 48 hours and i believed in his words for i was referred to him by a friend who he helped and right now, my ex lover is back and we are living happily together to get married next month. If you need any assistance whatsoever like getting cured from sickness, getting pregnant E.T.C. Then, I suggest that you get in touch with dr oyimeanel now through his Email ID: oyimeanelisiramen@gmail.com and WhatsApp him on+2348117963221 for more information. Thank you sir.

    ReplyDelete
  23. The post is very supportive as it helped me to solve numerous queries related to my assignment and I was so glad about the end result. I would recommend you guys to choose ganeshaspeaks for astrology.

    ReplyDelete
  24. Your blog provided with valuable information. thanks for this blog it's really helpful for students.
    Assignment Helper

    ReplyDelete
  25. Amazing post! The article shared by is highly informative. Complete my assignment has been helping out the students with some reliable all assignment help services for more than a decade now.

    ReplyDelete
  26. Your information is very detailed and useful to me, thank you for sharing. I hope you will always be up to date. know about anveshi jain.

    ReplyDelete
  27. I am sharing this testimony to partners suffering in their relationships because there is an enduring solution.
    My husband left me and our 3 kids for another woman after 8 years. I tried to be strong just for my kids but I could not control the pains that torment my heart because it was too painful to bear. I was hurt and confused didnt know what to do I needed a help, so i did a research on the internet and came across a site where I saw that Dr UDI a spellcaster not just a spellcaster but a powerful one indeed and he can help get lovers back. I contacted him and he did a special prayer and spells for me and told me to go cool off wish i eventally did. To my greatest surprises, few days later, my husband came back home. what i taught was imposible became possible because of DR UDI. That was how we Became reunited again and renewed our vows and believe me there lot of love, joy and peace in the family.
    You can as well contact DR UDI, a powerful spell-caster for solutions on his contact Ultimatespellhome@gmail.com or via Whats App: +2348051243538

    ReplyDelete
  28. I will always keep on writing good and posting my testimonies about you on the Internet,I have been diagnosis with Parkinson for 3 yrs I was tested Parkinson positive,I lost hope and I wept all day,i needed to get cured on time so i was introduced by a blogger who also narrated Her story online on how she was cured of Parkinson by a herbal medication which was sent by Dr Ben i am totally free from Parkinson for anyone that may need the cure should contact Dr Ben on

    Benherbalcure@gmail.com
    Whatsapp him on +905385050893

    ReplyDelete
  29. Hey all, here is the detailed informative page about Sarkari Result Exams, a website which is well known for its genuine information about government jobs.
    Checkout each and every detail you want to inquire about the website.
    Thanks.

    ReplyDelete