|
| ||
|
searching |
|
Fravia's |
Introduction •• +Fravia's searching tips •• Other seekers' tips •• Seekers' proverbs
The following 'tips' are mostly targeted for SHORTTERM fast searching.
If you embark in a longterm searching project, be aware that some ad hoc searching techniques will be different.
Ditto for "deep web" searching purposes.
And do not forget the general golden rules for all kind of web-searching either.
On the ad hoc Quickforms page you'll find a useful mask listing the most important (in our biased opinion) among the (many) main search engines. Shortterm broad searches can be all usefully started from there.
This page is peppered with "seekers' proverbs" (gatered alltogether here), because deemed useful for meme-mnemonic purposes... and also because they are great fun :-)
Note that some of the examples given here can be used for any kind of search, and are not necessarily limited to short term searches.
Indeed for any search, shortterm or longterm, a very important thing, a priority, is its preparation: where are you going to search and what are you going to search. Both these aspects require some thoughts.
A simple short "auto-brainstorming" before beginning your search, writing down your scope and a preliminary list of keywords (and query terms) will pay jackpots whenever you risk to run amok and then get lost inside the dark web-woods: there's simply too much interesting stuff on the web, and without some self-discipline and a clear scope you'll waste a lot of time when searching. Remember that if a seeker hasn't found what he wanted in 15 minutes (on a short term search... for long term searches things are different) then his search strategy is wrong. If it happens, ditch it and start anew.
In this aspect, as you can see, a search is not all that different from that "hyde and seek" children's finding game, where a limited area of play should be chosen and the seeker must close his eyes and count to 40 before beginning to search.
So avoid running onto google shouting "Ready or not, here I come!" :-)
THINK ABOUT YOUR QUERY! •• USE VARIOUS RESOURCES! •• KEEP ON TRACK! •• MORE THAN ONE SEARCH TERM!
EXACT SEQUENCE •• NARROW DOWN •• DOWNSIDE OF THE + •• DOWNSIDE OF THE BOOLEAN OPS
PECULIAR STRINGS & QUERYTERMS! •• SPECIAL OPERATORS •• ARCHIVE YOUR SEARCHES!
SNOOPING BOLDLY AROUND •• THE YO-YO TECHNIQUE •• GO REGIONAL!
-
THINK ABOUT YOUR QUERY!
Seekers do not "plunge" into a search out of the blue. Like artists, they visualize the correct result before they begin. The 'perfect' answer is driving their queries. The perfect answer creates the correct question(s)
What kind of results do you want? Books? Doctoral thesis? Images? News? Biographies? How many results do you want? Three hundred pages of material? One single authoritative book? A dozen pdf-articles? A short and concise essay?
Obviously you cannot be an expert in all and every field of any and every query you will launch. But you must be an expert in the field of finding the right resources for each and every kind of query.
Two skills a seeker needs: how to formulate a question correctly and knowing where to look. And this means knowing which resources you should use for your searches. And this means you must first of all know how to search those very resources you should use for your searches.
In fact each 'part' of the web requires a different approach. For instance, searches on usenet, on blogs or on ftp servers are not ruled by the same lore. Also each kind of target, each quarry, requires a different approach: for instance when searching news, images or books.
You must also decide if for a given query you will have to use combing techniques like stalking, luring or trolling.
Before even beginning, think about your query: prepare your question(s) for the perfect result and decide which resources you will use.
There is no shame in not knowing: the shame lies in not finding out
-
USE VARIOUS RESOURCES!
Should I give only ONE advice, it would be this one. Even more important than "keeping on track" (see below). Never, never, never overestimate your search tool of choice. EACH search engine, main, regional or local has its own quirks and its own blindness patterns ("shadows").
Everytime you 'restart' a given search on THE SAME SEARCH ENGINE with a slightly different synonimical query, or on ANOTHER SEARCH ENGINE (they don't overlap that much, after all) or on a more specific/local search engine you will get different results... Thus you shouldIn large rivers one finds big fish but one may also be drowned. NEVER 'stick' to a given search engine 'of choice'. Learn how much they differ and - even more important - understand how much their own results changes over time!
The web is a quicksand, with tides, and search engines databases AND ALGORITHMS are continuously changing as well. Many among the main search engines are for instance now actively 'censoring' results, as you will quickly realize if you search for -say- MP3 or DVD reversing.
Google alone & you'll never be done!
- KEEP ON TRACK!
Nothing easier than to loose your thread when you are searching the web.
As an example you could actually take this site of mine. Many of the query-examples given here represent links to other interesting (I hope) searches / places / startpoints / querystrings.
Thus the examples and links scattered around these pages should offer you continuous opportunities to leave this site in order to browse to other very promising ones.
This is done on purpose and makes one of the differences between searchlores and most other sites: The "hyper-bastard" approach to web page building is to restrict click-away opportunities to a bare minimum. Even when a reference demands a link, many methods are used to hide (or at least reduce the visibility) of those links.
Everything is made in order to keep a visitor 'caged' or 'trapped' inside a given site. Here you'll find the exact contrary, since you must learn some discipline if you'r going to be a good seeker: You leave my site for good while searching for a target? You'll never come back? Good riddance.
That's the problem you'll encounter again and again on the web. You start with an aim, a scope, and you land inside an unknown forest of results you where actually not looking for. While this may be great fun if you take it as a "divertissement" once in a while, it is surely not in the interest of a seeker to walk astray. The web is a labyrinth with many exits and few entrances. Hence the fundamental importance of a clear scope and of an array of related terms when you search.
You may find the worst enemy or best friend in yourself
- MORE THAN ONE SEARCH TERM!
Always try to start a query with more than one term!. It is true that in some cases you will gather angles as you go, and that "peculiar" words (see point 9) will make all (or most of) the difference, still the web is so full of crap that one word searches deliver very rarely nowadays.
This is (generally) so true that even zombies are slowly understanding it: two and three words queries amount now (2009) to more than one half of all queries, while "one word" searches are diminishing more and more.
Terminologically, note that the beastly SEOs (may they all rot in hell: search engine spammers, the bunch of them, that dare call themselves "Search engines optimizers"), often speak of "general" queries (for one or two words queries and "long tail" queries (for all queries with three or more search terms).
Finally note that in February 2009 google changed the SERPs introducing longer context snippets inside the results. Users however will see them only when searching withy multiwords, longer queries. These longer context snippets display more text (showing more of the keywords used in the query and on the resulting pages).
Compare search strategies with search strategies tips hints techniques.One-two-three-four and if possible even mor'
Three terms and it's clear: the signal will appear!
- EXACT SEQUENCE (and/or purposed misspelling)[""]
Enclose terms in double quotation marks if you want to retrieve those exact terms in that exact sequence. This is one of the most useful ways to cut ballast out in order to find a specific target. Thus "searchengines" will give you pages with the two terms 'glued' together, "search engines" will give you results with the two terms separated (by a space OR by an interpunction) while "search engines results" OR "searchengines results" OR "s.e. results" will give you pages with ANY of these three occurrences.
Note that some relevant pages may still remain outside your vision. At times misspelling can be used for better searching: "saerch engines" will retrieve pages WITH THIS SAME (and common) MISSPELLING ERROR. Try for instance serach strategies :-)
A wise man getting few results at night
tries new spelling, even if it's right
- NARROW DOWN AND & +
and ELIMINATE MERCILESSY
AND NOT & -
Narrow your searches by linking your search terms with AND or &, or simply use the plus sign [+]. The search engine will find only those pages that contain all of your search terms. Similarly, exclude pages that are not relevant to your search by preceding the search term with AND NOT or | or simply use the minus sign [-]. +"search engines" +hints +tips +techniques -tits -sex -"make money" is better than the more simple +"search engines" +hints +tips +techniquesTake heed you do not find what you do not seek
- DOWNSIDE OF THE + & - SIGN
With the + sign you may miss related documents that don't have the words you specify as required. For example, the search "searching tips" +searchlores would ONLY LIST results that have the words "searching tips", if they also have the term "searchlores".
With the - sign it's, on the other hand, easy to exclude too much. For example, if you were looking for information on "bots script" but not in javascript, the search +"bots scripts" -javascript would exclude any document about bots scripts with a sentence like "this kind of bot would be impossible in javascript" (it's just an example: there's on the web no page -apart this one you are reading- with that specific sentence, which means you could also use such a link for perennial linking, coz it would work indipendently from wherever I could move this page)
- DOWNSIDE OF THE BOOLEAN
operators
Some search engines, like Fast/Alltheweb have a special boolean box for a very limited boolean searching pleasure (AND, OR and NOT).
It's often difficult to specify exactly what you want to include or exclude. You can also get unexpected results if you are not careful about your use of operators and parentheses.
For example, the search seeking OR searching AND "finding good results" is the same as the search seeking OR (searching AND "finding good results").
Both queries will find documents that contain both searching and "finding good results" (good results added in order to keep results down), together with documents that contain the word seeking. However, the query (seeking OR searching) AND "finding good results" is not the same. It will find documents containing the word "finding good results" and, in the same document, either seeking or searching. (Incidentally if you get a first result, as in this case, that BREAKS the OR operator, because it has both searching and seeking, you discover a paying-spam site that shouldn't be in the first position at all).
Anyway the point is: be careful with the boolean operators!
In large rivers one finds big fish, but one may also be drowned
- PECULIAR STRINGS & QUERYTERMS!
A most important tip! You should always strive to use differentiating keywords when searching the web. Words that are commonly used will not help you much. Besides, extremely common words, like articles and prepositions ("stopwords") are often completely ignored unless you force them with a + (of course each language has its own ad hoc set of stopwords, for english usually the following ones: the, and, a, to, of, in, i, is, that, it, on, you, this, for, but, with, are, have, be, at, or, as, was, so, if, out, not). Thus a search like but not me again with you is rather pointless, if you really need that, try at least to break it into chunks: "but not me again" "with you".
Try to use words which underline the peculiarity of your target. Common words, when combined with boolean qualifiers, can be very effective. As usual when web-searching, gather words to build your ad hoc "core vocabulary": you must identify the main concepts in your topic and determine any synonyms, alternate spellings, or variant word forms for the concepts. Remember that the most "peculiar" a word, the more useful it will be in order to sharpen your search.
+ title:"search strategies" +hints +tips (and &nbq=50)
in this case we did include the "search strateg*" string (which already has an elevate Peculiarity) in the title: special search term (parameter/operator).
(Incidentally this kind of search is also useful to discover plagiarists and copycutter clowns :-)
Experiment! Try for instance the broad (peculiar) opening queries:
searching.knowledge OR searching.experience OR searching.intuition -site:com
or
"perfect.searcher" OR "best.searcher" OR "accomplished.searcher" -site:com
or the narrower (peculiar), closing ones:
"web searching successes" -site:com
"amazing search engine secrets" -site:com
"educated.seeker" -site:com :-)
To find your edge use words as wedge
- SPECIAL OPERATORS
Note the use of advanced operators and special parameters in the previous example. Here a list of the "special search terms" for altavista:- domain:domainname to avoid
useless noise try excluding all commercial crapola with -"domain:com"
- host:name
- link:URLtext
- inurl:text
the "inurl:" operator is a godsend for any educated seeker
- title:text
the "title:" operator is always most
useful for narrowing your queries
- url:text
Each search engine has its own advanced operators, and seekers are nowadays is pretty much compelled to study google's and yahoo's (and maybe MSN's) ones.
- ASTERISK[*]
Note also the use of the asterisk [*] in the example "index+of/" "rain.wav******": usually on most search engines an asterisk must be used after at least 3 characters from the beginning of the term, and it is valid for up to 5 characters (or as an element of a phrase). - Question Mark (?): After 3
specified characters will match
exactly one more character.
- Double (or more) Asterisks (**)
More flexible operator, as it will search for
matches for an unlimited number of
trailing characters.
- domain:domainname to avoid
useless noise try excluding all commercial crapola with -"domain:com"
- ARCHIVE YOUR SEARCHES!
You should archive your useful queries and repeat them over time. All search engines queries can be saved and used again later. Since the results of all queryes VARY WITH THE TIDE (when traffic is particolarly heavy the search engines "cut" the results) you would be well advised, for important queries, to repeat them again and again in other timeframes.
Keep records of all your search activities! Systematic record keeping is OF PARAMOUNT IMPORTANCE when searching. The classical mistake of almost all newbie seekers is to 'forget' to keep records during their searches.
For this purpose I suggest you simply use the NOTE function in Opera, just highlight the target text you are interested in, rightclick, and then chose copy to note (or use the keyboard shortcuts, either CTRL+SHIFT+C or CTRL+ALT+E depending from the version of Opera you are using): the URL of the page you'r viewing at that moment and the date will be automatically stored in your note together with the highlighted text.
You should create ad hoc note folders (for instance "research_on_canaletto_29SEP2005") and, at the end of your search, before switching the box off and go to sleep, just move all your related notes inside the correct folders. Opera's Notes are just text format, very easy to edit, cat, search or prune.
Alternatively use something else, even a pen and a sheet of paper will do. DO NOT rely on your memory alone (or on your extraordinary seeking capabilities to re-find at once what you may have lost :-)
If you do, you will regret it. Sooner than you believe.
-
SNOOPING BOLDLY AROUND
As you'll learn elsewhere on this site, there are many methods to access some -ahem- 'non public' portions of the web.
A quick, simple tip, is to always look for the presence of a file called ROBOTS.TXT in the main directory of your target site, entering per hand the URL; let's say:
http://www.targetsite.com/robots.txt
This file is used to tell search engines which directories and files they should not index on a specific site. Thus anything that has been put inside a 'robots.txt' file will not (well, "should not", in fact not all search engines 'behave') be found by your searchqueries. However, once you have seen the name of the forbidden subdirectories, you can still type them directly into your browser in order to access all their pages.
- THE YO-YO TECHNIQUE
The 'down yonder' problem is well known by searchers. Being easily spammed by the beastly SEOs, all main search engines -and especially google- suffer a terrible draw-back: indeed some interesting results may be listed somewhere, yet the spam-cram keeps popping up in the first positions while the juicy targets you are looking for lie buried somewhere inside those huge SERPs, 'down yonder'.
There is an interesting approach called the Yo-yo approach, that can be used for most main search engines.
- GO REGIONAL!
A fantastic tip: go regional, both using regional search engines or using some linguistic tricks. This can work even for languages you do not know and/or using ad hoc dictionaries and translation free services.
The depth you can reach on a specific search using a -say- korean search engine cannot be surpassed by any simple google search. Go regional everytime you're stuck. Go regional for the fun. Go regional for combing and stalking purposes. You wont regret it!
Some notes: fast vs slow searching (by Mordred)
There is a side to searching which - while actually well covered in information - is not clearly stated - WHEN do you want your results. I think that there is an important border between finding fast (FF: that's when you need a quick answer) and finding slow (SF) (for example:
- things that are NOT YET answered,
- generic time consuming research,
- searching for "all of" (instead of "any of", which is more likely into the FF category)
Thus various search techniques can be applied to the two categories:
- klebing, luring, ask-an-expert combing, password breaking are slow finding (SF) methods
- webbits, keyword shortcuts, and other similar tricks are fast finding (FF) methods
- some, like combing & yoyo, are useful in both cases
For example, searches of 'where is my car' type are obviously calls for quick answers, and if the info you need is short, you can even get it in the SERP summaries (the asterisk (*) trick is nice, and also 'asking the answer'). Yesterday I looked for some time the metaspy erom mentioned at the seeker's and saw with my very eyes the query [what is brittany speers shoe size], I swear! With a quick fix of the spelling and some quotes you can get ["britney spears" "shoe size *"] faster than the guy can figure out why google asks him for an alternative spelling, when his own is undoubtedly right.
Also, a useful thing to mention is what to do when you realize your search strategy is wrong - like:
If you get little or no results in a main SE, switch to metasearch.
If your keywords are too generic, try a SE that can cluster results (kartoo-like) until you learn enough specific keywords about your target.
If your target is very topic specific, find a topic-centric SE
(Slow/Fast: see also the distinction between these "short term" searching tips and the techniques proposed for
long term searching ~ fravia+)
Quaerite et invenietis
(Very ancient seekers' lore)
(Seek, and ye shall find: Matthew 7:7)
Google alone & you'll never be done!
(Fravia)
(About the importance of using more than one search engine)
A wise man getting few results at night
tries new spelling, even if it's right
(Mordred)
To find out about the web ahead, ask those coming back
(Fravia)
(About the importance of combing the web)
Lowercase
just in case
(Fravia)
(This was very important once upon a time... recently only altavista still cared, and now even altavista is dead, killed by yahoo)
Aut inveniam viam aut faciam!
(Proud motto of Olaus Hermelin's "Ur-seekers" @ the Academia gustaviana in Tartu)
(Indeed an inspirational searchers' war-cry)
One-two-three-four
and if possible even mor'!
(Fravia)
(About the importance of using multi-terms queries)
There is no shame in not knowing: the shame lies in not finding out
(Ancient seekers' lore)
Take heed you do not find what you do not seek
(Ancient seekers' lore)
("Narrow down" your queries!
Hic alta, hic salta
(Fravia)
(With spammed search engines like Altavista jump down to the lower results' pages to avoid the spam at the top, see also the "YO-YO Technique")
Refine, refine & then refine again
but cross your fingers meantime
(Seekers' lore)
(When the query is too broad)
To find your edge
use words as wedge
(Fravia)
(See the peculiar words tip)
Few results on google too?
Don't waste time and use kartoo!
(Mordred)
Three terms and it's clear:
the signal will appear
(Fravia)
(About the importance of using multi-terms queries)
Page optimised for Opera. Other browsers? Couldn't care less.