Viewing a single comment thread. View all comments

Temporary-Warning-34 t1_jcpwu9p wrote

'Feedback bootstrap'. Lol.

Sorry. What does that mean?

9

MysteryInc152 OP t1_jcpzgd4 wrote

Bootstrapping is basically taking a model's best/better outputs on a certain task and finetuning on that.

EDIT: Seems I'm wrong on that

15

MisterManuscript t1_jcry6cj wrote

That's not what bootstrapping is, it is a resampling technique used to create multiple datasets of the same size from the original dataset using random sampling with replacement. It is done to get the estimate of the standard deviation of a desired variable.

Here's the link to the ISLR textbook. The bootstrap chapter will verify what it is.

17

MysteryInc152 OP t1_jcrz16i wrote

Yeah I'm wrong it seems. Read a few articles using bootstrapping in the definition I used so I assumed that was generally it.

6

relevantmeemayhere t1_jcrotun wrote

Mm, not really.

Bootstrapping is used to determine the standard error of estimates using resampling. From here we can derive tools like confidence intervals, or other interval estimates.

Generally speaking you do not use the bootstrap to tweak the parameters of your model. You use cross validation to do so.

10

relevantmeemayhere t1_jcrp2rr wrote

Honestly, really comes off as word salad lol.

I haven’t read the details, but it sounds like resampling in a serial learner?

6

visarga t1_jctfir1 wrote

Human Feedback is being boostsrapped by GPT3 predictions "stolen" against OpenAI's will (for just $500 API bills).

1

MisterManuscript t1_jcrwvc8 wrote

I tried googling it, it's is a nonexistent terminology in the realm of statistics. I know what bootstrapping is, but not this version of it.

It's better to ask the GitHub authors about this to make sure they're not just spitting out pseudostatistical terminology.

Addendum: another guy did query the authors regarding this terminology in the issues tab, they did not respond.

2