I notice that CS.meta is heavily focused on question quality, and has virtually no discussion on answer quality. This is exemplified by @StevenJeuris's excellent comprehensive summary (and continuing discussion), that links to dozens of posts on questions. I suspect this focus is at least partly due to the way CS.SE's performance is tied to reducing the ratio of questions to answers, so there is incentive to reduce low quality / unanswered questions, but less incentive to reduce low quality / bad answers.
However, the purported benefit of reducing questions for attracting professionals to the community is only speculative. The science-minded of us know that to really find out how much it would benefit the community to tighten down on questions is to test it. I suggest that the quality of answers may also play a part in attracting or repelling professionals. That said, I hope this post might be useful for starting a discussion.
Note that the example answers I include below are still there as of this writing (several are upvoted and one of them is even an accepted answer!), so I don't think the current system of flagging, downvoting, and moderating is as effective as it could be. I myself have been discouraged from flagging or recommending for deletion non-scientific answers on the grounds that they don't violate any of the forum's policies, and would like to see that changed. This is my proposal:
The "flag" link for Answers has the following options:
- rude or abusive
- not an answer
- in need of moderator intervention
Additionally, when reviewing Low Quality Posts (ie, flagged answers), the "Recommend Deletion" button has the following options:
- No comment needed
- This is commentary on another post, not an answer
- This is a “thank you” comment
- This is an “I’m having this problem, too” comment
- This is a different question posted as an answer
- This is a link-only answer (and not spam)
- I would like to see a "flag" option: "not a science-based answer" - in addition to or in place of the current "not an answer" option - to discourage / remove unscientific opinion answers.
- "Recommend Deletion" options 2, 3, and 4 are basically the same (this is a comment, not an answer - common for new users without sufficient reputation to comment), and should be merged as there is little reason to differentiate between them.
- In their place, I would like to see the same option: "not a science-based answer" - to support the proposed "flag" option.
These suggestions address the case where users treat the forum like a social media site (eg, reddit or slashdot), and post "opinion" answers, with no attempt to suggest that they have any grounds or basis for their assertions (example, example, example, example, example). Related to this, and possibly covered by the same option, are "data point" (anecdotal) answers that merely share personal experience (example, example, example).
Note: This case is different from the one mentioned here - the latter implying that answers make assertions based on unsourced / uncited evidence (and are not recommended for deletion), which is perhaps due to laziness rather than lack of scientific rigour, whereas the option I'm proposing is for answers that make assertions based on personal opinion / experience / belief, with no indication that supportive evidence even exists (and should be recommended for deletion).