Anatomy of an NSF proposal

My basic rule-of-thumb is:

Broader impact/diversity/education

This is probably the area that has changed the most in the last 10 years, and requires a lot more thought/effort than it use to. Be as concrete as you can (list organizations, specific actions, outreach opportunities, preferably ones you already have a relationship with) and be realistic! Better to do one or two things well then try to do outreach to every community out there. The most important thing is to start these collaborations NOW, so that you can say "I am doing…" instead of "I will do".

Linking education and diversity with your research can be challenging, but try.

The biggest way to sell your broader impact is to have a collaborator outside of your field and a very concrete list of goals/problems from that collaborator. Again, start this early, because it can take 6-12 months to really start to see how your work can fit in with the goals of someone in an outside field. But it's well worth it, because these are the problems that will drive your next proposal…

Data management plan

This is relatively new, and basically arose because congress got tired of paid-for research/data disappearing as soon as the grant ended. These haven't really stabilized in content (unlike the facilities statement) but so far they seem to be a specific listing of the mechanisms by which your data/source code/papers will be archived. Also not a bad place to reiterate your commitment to, say, open source software - i.e., we will release this as part of Sourceforge/Git hub/Bit Bucket, etc. Usually also includes some sort of statement about how the data (usually on a web-page) will be archived for the long term. Your university may have established a data archive (sometimes through the library) that you can use.

Budget

I don't think I've seen a proposal killed because of an excessive budget (or a too small one), but it will result in reviewers making nasty comments about you to each other. Just remember that anyone who has a substantial role in the project should have commensurate funding (especially outreach activities). If you lay out a time-line with research problems and people assigned to them, then that should serve as a check on whether or not you have too many/too few people/the correct resources.

NSF may cut your budget anyhow. If they decide to, make sure you're clear about what you're going to cut out of the proposal in response.

Other forms

The other forms you'll have to fill out are the facilities and budget justification, and possibly a mentoring plan (post-doc) or a collaboration plan (multiple institutions). Your grant office should be able to help with these, but if not, find someone who's had a grant funded and borrow mercilessly. Your grant office may have very specific ideas of the format of the budget justification. Listen to them.

Collaboration letters: Include only if someone will be actively contributing time/resources to your project. Some program managers are really picky about this - they don't want to see letters of the form "I think this person will do an excellent job, and I can't wait to see their research".

Career: Your department chair must write a letter for you. Be kind, and give them plenty of warning. This letter should demonstrate the support of the department for your research.